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Preface 


The world around us adapts over time in response to changing conditions. New pat¬ 
terns emerge all the time, necessitating the development of theories that underpin the driv¬ 
ing processes. Practically all natural processes are complex and natural scientists have 
began to grapple with the complexity studies to manage and influence the driving forces. 
The nature of relationships and interactions between humans has, in turn, led the social 
scientists to adopt ideas from these studies to develop a framework better amenable to 
measurement and interpretations. 

The evolution process is driven by self-organization, and not by some centralized 
entity. The resulting complexity of interactions makes it impossible to predict, with a 
degree of certainty, many aspects of system behaviour. The nonlinear dependance between 
cause and effect lies at the root of these dynamical interactions. 

This book offers a unique viewpoint into the complementary aspects of fractals and 
complexity and provides a unifying thread in this multidisciplinary research. Do the non¬ 
linear interactions play a role in the complexity management of socio-political systems? Is 
it possible to extract the global properties of genetic regulatory networks without knowing 
details of individual genes? What can one learn by transplanting the self-organization ef¬ 
fects known in laser processes to the study of emotions? What can the change in the level 
of complexity tell us about the physiological state of the organism? The reader will enjoy 
finding the answers to these and many other questions in this book. 

This volume is the 9 th is this series of publications, which are based on presentations 
at regular conferences organized in different locations worldwide. The distinguishing fea¬ 
ture of the series is its vibrant, multidisciplinary nature taking place in collegiate atmo¬ 
sphere. The multidisciplinary feature has been growing more prominent with every new 
event. 

Fractal 2006 was made possible through the help of the following members of the 
programme committee (in alphabetical order): 

P. Allegrini (Italy), M. Cieplak (Poland), D. Dhar (India), K. Falconer (UK), L. Gar- 
dini (Italy), H. Haken (Germany), R. Hilfer (Germany), A. Holden (UK), A. Hubler (USA), 
H. J. Jensen (UK), L. S. Liebovitch (USA), S. Lowen (USA), F. Mainardi (Italy), 
Ch. Mira (France), T. Nagatani (Japan), E. Scalas (Italy), W. H. Steeb (South Africa), 
C. Tricot (France), B. J. West (USA) 

The Fractal 2006 conference was partially supported by Emergentis Ltd. 

The details about the next conference in this series will be posted on the web site 
http://www.kingston.ac.uk/fractal/. 


M. M. Novalc 

Kingslon-wpon-Thames, UK 
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The expression of some genes increases or decreases the expression of other genes forming 
a complex network of interactions. Typically, correlations between the expression of 
different genes under different conditions have been used to identify specific regulatory 
links between specific genes. Instead of that “bottom up” approach, here we try to 
identify the global types of networks present from the global statistical properties of the 
mRNA expression. We do this by comparing the statistics of mRNA computed from 
different network models, including random and fractal, scale free networks, to that 
found experimentally. The novel features of our approach are that: 1) we derive an 
explicit form of the connection matrix between genes to represent scale free models with 
arbitrary scaling exponents, 2) we extend Boolean networks to quantitative regulatory 
connections and quantitative mRNA expression concentrations, 3) we identify possible 
types of global genetic regulatory networks and their parameters from the experimental 
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1. Introduction 

The information encoded in deoxyribonucleic acid, DNA, in genes is transcribed into 
messenger ribonucleic acid, mRNA, that is then translated into proteins that per¬ 
form the structural and functional characteristics of cells. Some of these proteins, 
called transcription factors, then bind back onto DNA increasing, or decreasing, 
the expression of other genes. Recent co-regulational studies have used different 
computational methods to evaluate the correlations in mRNA concentrations under 
different experimental conditions to determine the network of genetic regulation. 
These methods include correlation analysis, cluster analysis, neural networks, ge¬ 
netic algorithms, and singular value decomposition (principal component analysis) 
with or without additional constraints 1 - 18 . Instead of the “bottom up” method of 
those co-regulational studies, our approach here emphasizes a “top down” method 
to try to identify global patterns of genetic regulation. We do this in the following 
way: 1) We formulate different types of models of networks of genetic regulation. 
2) We compute the probability density function, PDF, of the mRNA from each 
network. 3) We then compare those results to the experimental data from mRNA 
concentrations measured by cDNA microarray chips. By looking for the global fea¬ 
tures of the genetic regulatory network, as characterized by the PDF of the mRNA, 
we may be able to identify different types of genetic regulatory networks without 
the need to first identify which specific gene regulates which other specific gene. 

2. Models of Genetic Regulatory Networks 

We represent the genetic regulatory network of N genes by a connection matrix M, 
where M (i,j ) is the regulatory effect of the j-th gene on the i-th gene. Thus, the reg¬ 
ulatory effects can be made quantitative which is an extension of the all or nothing 
(0 or 1) of Boolean models. Connection matrices with both positive (stimulatory) 
and negative (inhibitory) elements can cause a broad range of complex behavior. 
We are therefore faced with a trade off between studying less complex models that 
we can successfully analyze and more complex models which would be much more 
difficult to analyze. Therefore, in these initial studies, we restrict ourselves to con¬ 
nection matrices with only stimulatory behavior where all the elements are greater 
than or equal to zero so that the mRNA concentrations will always reach a steady 
state with a characteristic probability density function. 

We studied connection matrices with random, 19 fractal scale free, and small 
world 20 ’ 21 ’ 22 connection topologies. Each connection matrix was 1000 x 1000 to 
model the interactions between 1000 genes. Interactions between genes i and j were 
represented by M(i,j) = 1, while all other M(i,j) — 0. 

Each different model is characterized by the degree distribution of the number 
of genes g connected to other genes k. In the models with random connections, the 
degree distribution, of either the inputs into the genes or the outputs from the genes, 
have the Poisson distribution g(k ) = ~tf e~ <k> where there are on average <k> 
interactions between genes. We formulate both Random Output and Random Input 
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models. 

In the fractal scale free models the degree distribution has the power law form 
g(k) — Ak~ a . We formulate three types of such models. First, where the degree 
distribution of the outputs from the genes is a such a power law. In this model the 
statistical pattern of input regulation into each gene is the same, namely each gene 
has a small number of inputs from the lower order genes and ever more inputs from 
ever more higher order genes. We call this the Scale Free Homogeneous model since 
the statistical pattern of inputs into each gene is the same. In the second model, the 
statistical pattern of input regulation into each gene is a power law. Different genes 
have different average numbers of connections to other genes. We therefore call this 
model the Scale Free Heterogeneous model. In the third model, we adjust both the 
input and output degree distributions to have the same form, and therefore call this 
model the Scale Free Symmetric model. 

To formulate the scale free models we chose the number of nonzero elements 
in the columns of M(i,j ) for the Homogeneous model, the number of nonzero el¬ 
ements in the rows of M(i,j) for the Heterogeneous model, and the number of 
nonzero elements in diagonals of M(i,j) for the Symmetric model as given by 
Y(r) = ( (q— i)fjv— w h er e r is the distance, respectively, from the start¬ 
ing column, row, or corner of the matrix. This relationship was derived by noting 
that the number g(k)dk of genes with k connections over the interval ( k, k + dk) is 
equal to the number of nonzero elements, dr, with Y(r) = k connections over the 
corresponding interval (r,r+dr). This relationship between g(k) and Y(r) provides 
a useful explicit way to generate connection matrices corresponding to a scale free 
model with a given scaling exponent a without having to from the network iter¬ 
atively using a growth rule to preferentially add nodes 23 ’ 24 . In all three models 
we varied the scaling parameter over the range 1 < o < 6. We also computed the 
average path length between any pairs of genes through their connections and the 
clustering coefficient 29 . All of the scale free networks had both shorter path length 
and higher clustering coefficient than that of the random networks with the same 
< k > indicating that these scale free networks were all “small world” networks. 

In both the random and scale free models we adjusted the density of non-zero 
elements so that each model had the same number of average connections < k >= 6 
between genes. 


3. Statistics of the mRNA from the Different Models 

We then represent the mRNA level expressed by gene i of the N genes by an element 
in the column vector X(i). We start with initial values of the elements of X(i). 
At each subsequent time step the new elements of X'(i) are then computed from 
X 1 - MX. 

Some of the models presented here can be cast in a the form of Markovian 
matrices, that is, where each row (or column) has an identical sum (equal to 1 if all 
the elements are properly normalized). In that case, the matrix M has an eigenvalue 
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of unity and the iteration process X' = MX converges to a steady state. However, 
the scale free models cannot be cast into that form. In that case, we renormalized 
the norm of the vector X at each time step. That is, for these models the relative 
values of the elements reach a steady state in the direction of the vector X, although 
its length continues to increase or decrease. In reality, biological constraints, such 
as the finite number of mRNA molecules that can be synthesized, will constrain the 
norm of the vector A to a finite nonzero value. 

Some models, for example, the Random Output model, can be formulated as 
either a Markovian or non-Markovian matrix. For such models we found that the 
direct iteration of X' = MX of the Markovian matrix and the renormalization of 
X at each time step of the iteration of non-Markovian matrix both produced very 
similar steady state statistical patterns of mRNA expression, giving credence to 
our renormalization procedure used to compute the models with non-Markovian 
matrices. 



-3 -2 -1 0 -5 -4 -3 -2 

Log 1() mRNA Log, 0 mRNA 


Figure 1. PDFs of mRNA concentrations computed from different models of genetic regulatory 
networks. Counter-clockwise starting from the top left: 1) Random Output model, 2) Random In¬ 
put model, 3) Scale Free Symmetric model with scaling exponent a=2, 4) Scale Free Heterogeneous 
model with a=2, and 5) Scale Free Homogeneous model with a=-2. 


At steady state, we then determine the PDF, the probability density function 
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that any of the mRNA concentrations, X(i) = x, is between x and x + dx. Our 
approach is to analyze the statistical form of the PDF of all the mRNA concentra¬ 
tions, and we do not determine which specific gene is associated with which specific 
mRNA concentration. That makes it possible for our approach to identify global 
properties of the genetic regulatory network without first needing to identify the 
specific regulatory connections between specific genes. 

The standard method is to compute the PDF from the histogram of the number 
of values n( x) in each interval [a;, a; + dx], namely PDF(x) — jtfa- Using this 
method, when dx is small, the PDF is well characterized at small x, but poorly 
characterized at large x since there are few values in each narrow bin in the tail of 
the distribution. When dx is large more values are captured in each bin at large x, 
but now the resolution of the PDF is poor at small x. We overcome these limitations 
by using an algorithm that combines histograms of different bins size dx so that it 
generates PDFs that are accurate both at small dx and at large dx 25 . The results 
for 2 random and 3 scale free models are shown in Fig. 1 


4. Experimental Data 

The mRNA concentrations expressed by thousands or tens of thousands of genes 
can now be measured simultaneously by cDNA microarray chips where flourescently 
marked mRNA binds to complementary polynucleotide sequences bound to the chip 
2 e,27 \Y e calculated the PDFs of the mRNA concentrations measured by cDNA 
microarray chips used to study circadian rhythms in Drosophila flies 28 . Figure 2 
shows the PDF determined from wild type flies kept in total darkness. This form 



Log 1Q mRNA 


Figure 2. Typical PDF of mRNA concentrations computed from experimental data of virtually 
all the genes in Drospholia. 


of the PDF is typical of several different light and dark conditions for both the wild 



type flies and those with a mutation in the period gene that alters their circadian 
rhythm. 


5. Conclusions 

The experimental data analyzed here is most like the genetic regulatory network 
model of a fractal, Scale Free Symmetric network with a scaling exponent a of 
approximately 2 for the distributions of both the inputs into the genes and the 
outputs from the genes. However, since we have not shown that the PDFs of the 
mRNA concentrations are unique for each model, it is possible that other models 
that we have not studied might also provide an equally good fit to the experimental 
data. 

The Scale Free Symmetric model means that some genes are strongly regulated 
by the expression of only a few other individual genes, while other genes are regu¬ 
lated by the average expression of a large number of genes. Moreover, the degree 
distribution of the input regulation into each gene is the same as the degree distri¬ 
bution of the output regulation from each gene. 

The strength of our approach presented here is that we have been able to extract 
some information about the global properties of the genetic regulatory network with¬ 
out first determining which specific genes regulate which other specific genes. This 
was possible because we compared the PDF of the mRNA predictions of the models 
to the experimental data without considering which particular gene produced which 
particular mRNA concentration. 

Since we have shown here that different network architectures may have differ¬ 
ent PDFs of the mRNA concentrations, this may provide a way to identify different 
subnetworks, for example, metabolic vs. cell cycle regulatory networks. It may also 
prove useful in determining if those networks change under different conditions, 
for example, normal vs. metastatically transformed cells. If that is the case, then 
changes in the PDFs may be useful in identifying such cellular transformations and 
the degree of those transformations. If the PDFs are not different under different 
conditions, it may indicate that the overall global structure of these genetic regu¬ 
latory networks is so important to cell function that as some genes are turned off, 
other genes may be recruited to fulfill their missing function in the entire network, 
so that the overall structure of the network remains intact. 

Some aspects of these studies may also be useful in the analysis of other net¬ 
work systems. For example, we derived the distribution of nonzero elements in the 
connection matrix corresponding to scale free distributions with different scaling 
exponents. This makes it possible to explicitly construct scale free networks with¬ 
out the need to form them iteratively by using growth rules to add nodes to the 
network. An important question about networks is the relationship between their 
structure and dynamics. For example, in many experimental cases only the activity 
of the nodes of the network can be measured and one seeks to use that information 
to determine the structure of the network. For example, there are electrical record- 



ings from nerve cells and one seeks to use this information to understand how they 
are functionally connected, or there are traffic activity measures at routers and one 
seeks to understand the topology of the Internet. We found here that the tails of 
the PDFs of the mRNA concentrations axe related to the degree distribution. The 
mRNA concentrations correspond to the dynamic activity at the nodes of a network 
and the degree distribution to the structure of a network. This relationship forms 
an interesting link between the dynamics and the structure of a network, that may 
be, or may not be, present in other types of networks as well. 
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MODELING FRACTAL DYNAMICS 


BRUCE J. WEST 

Mathematical & Information Sciences Directorate, US Army Research Office, 


Research Triangle Park, NC 27709, USA 


The proper methodology for describing the dynamics of certain complex phenomena and fractal time 
series is the fractional calculus through the fractional Langevin equation discussed herein and 
applied in a biomedical context. We show that a fractional operator (derivative or integral) acting on 
a fractal function, yields another fractal function, allowing us to construct a fractional Langevin 
equation to describe the evolution of a fractal statistical process, for example, human gait and 
cerebral blood flow. The goal of this talk is to make clear how certain complex phenomena, such as 
those that are abundantly present in human physiology, can be faithfully described using dynamical 
models involving fractional differential stochastic equations.. These models are tested against 
existing d ata s ets a nd s hown t o d escribe t ime s eries from c omplex p hysiologic p henomena quite 
well. 


1. Introduction 


In the late nineteenth century, most mathematicians felt that a continuous function must 
have a derivative "almost everywhere", which means the derivative of a function is 
singular only on a set of points whose total length (measure) vanishes. However, some 
mathematicians wondered if functions existed that were continuous, but did not have a 
derivative at any point (continuous everywhere but differentiable nowhere). The 
motivation for considering such pathological functions was initiated within mathematics, 
for example, Karl Weierstrass (1815-1897) gave a lecture to the Berlin Academy in 1872 
in which he presented functions that had the aforementioned continuity and non¬ 
differentiability properties. Twenty-six years later, Ludwig B oltzmann, who elucidated 
the microscopic basis of entropy, said that physicists could have invented such functions 
in order to treat collisions among molecules in gases and fluids. It was assumed in the 
kinetic theory of gases that molecules are materially unchanged as a result of interactions 
with other molecules, and collisions are instantaneous events as would occur if the 
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molecules w ere impenetrable and perfectly elastic. Asa result, it seemed quite natural 
that the trajectories of molecules would sometimes undergo discontinuous changes. 
Robert Brown, in 1827, observed the random motion of a speck of pollen immersed in a 
water droplet. Discontinuous changes in the speed and direction of the motion of the 
pollen mote were observed, but the mechanism causing these changes was not 
understood. 

Albert Einstein published a paper in 1905 that, although concerned with 
diffusion in physical systems, ultimately explained the source of Brownian motion as 
being due to the net imbalance of the random collisions of the lighter particles of the 
medium with the surface of the pollen mote. Jean Baptiste Perrin, of the University of 
Paris, experimentally verified Einstein's predictions and received the Nobel Prize for his 
work in 1926. Perrin 1 , giving a physicist's view of mathematics in 1913, stated that 
curves without derivatives are more common than those special, but interesting ones, like 
the circle, that have derivatives. In fact he was quite adamant in his arguments 
emphasizing the importance of non-analytic functions for describing complex physical 
phenomena, such as Brownian motion. Thus, there are valid physical reasons for looking 
for these types of functions, but the scientific reasons became evident to the general 
scientific community only long after the mathematical discoveries made by Weierstrass. 

On the theoretical physics side, the Kolmogorov-Amold-Moser (KAM) theory 
for conservative dynamical systems, describes how the continuous trajectories of a 
particle break up into a chaotic sea of randomly disconnected points. Furthermore, the 
strange attractors of dissipative dynamical systems have a fractal dimension in phase 
space. Both these developments in classical dynamics, KAM theory and strange 
attractors, emphasize the importance of non-analytic functions in the description of the 
evolution of deterministic nonlinear dynamical systems. We do not discuss the details of 
such dynamical systems herein, but refer the reader to a number of excellent books on the 
subject ranging from the mathematical rigorous, but readable 2 , to provocative picture 
books 3 , to extensive applications 4 . 

The separation of time scales in physical phenomena allows us to smooth over 
the microscopic fluctuations and construct a differentiable representation of the dynamics 
on large space scales and long time scales. However, such smoothing is not always 
possible, examples of physical phenomena that resist this approach include turbulent fluid 
flow 5 , the stress relaxation of viscoelastic materials such as plastics and rubber 6,7 and 
finally phase transitions 8,9 . Metaphorically, these complex phenomena, whose evolution 
cannot be described by ordinary differential equations of motion; leap and jump in 
unexpected ways to obtain food; they unpredictably twist and turn to avoid capture, and 
suddenly change strategy to anticipate environmental changes. To understand these and 
other analogous processes in physiology we find that we must adopt a new type of 
modeling, one that is not in terms of ordinary or partial differential equations of motion. 
It is clear that the fundamental elements of complex physical phenomena, such as phase 
transitions, the deformation of plastics and the stress relaxation of polymers, satisfy 
Newton's laws. In these phenomena the evolution of individual particles are described by 
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ordinary differential equations that control the dynamics of individual particle 
trajectories. It is equally clear that the connection between the fundamental laws of 
motion controlling the individual particle dynamics and the observed large-scale 
dynamics cannot be made in any straightforward way. 

Herein we describe some of the essential features of fractal functions starting 
from the simple dynamical processes described by functions that are fractal, such as the 
Weierstrass function, that are continuous everywhere but are nowhere differentiable. This 
idea of non-differentiability leads to the introduction of the elementary definitions of 
fractional integrals and fractional derivatives starting from the limits of appropriately 
defined sums. We find that the relation between fractal functions and the fractional 
calculus is a deep one. For example, the fractional derivative of a regular function yields 
a fractal function of dimension determined by the order of the fractional derivative. Thus, 
the changes in time of phenomena that are best described by fractal functions are 
probably best described by fractional equations of motion, as well. In any event, this 
latter perspective is the one we developed elsewhere 10 and discuss herein. Others have 
also made inquires along these lines' 1 . 


2. Fractional calculus 

It is useful to have in mind the formalism of the fractional calculus before embarking on 
the interpretation of models using this formalism to explain the complexity of 
physiological phenomena. What we call the fractional calculus dates back to a question 
L’Hospital asked Leibniz in 1695, where in a letter he asked the meaning of the 
expression d n y / dx” if n=l/2, that is: ..what if n is fractional? 

Leibniz replied in part 12 _ 

Thus it follows that d l,2 x will be equal to 2 y/dx:x . John Bernoulli seems 

to have told you of my having mentioned to him a marvelous analogy which makes 
it possible to say in a way the successive differentials are in geometric 
progression. One can ask what would be a differential having as its exponent a fraction. 
You see that the result can be expressed by an infinite series. Although this seems 
removed from Geometry, which does not yet know of such fractional exponents, it 
appears that one day these paradoxes will yield useful consequences, since there is 
hardly a paradox without utility. 

After 310 years of sporadic development, the fractional calculus is now 
becoming sufficiently well developed and well known that books and articles are being 
devoted to its consequences in the physical sciences 13,14 ' 15 . 

One way to introduce fractional operators is by generalizing Cauchy’s formula 
for a rt-fold integration over a fixed time interval (a,t) 
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JO - fr 1 /fete = fj- ■ ■ J/fe.te. • •<*#, a'-’I/O)] . 

where the operator o Z)| ”^[-] denotes the n-fold integration operation. The fractional 
integral analogue to this equation is defined as 


.nfrWlfr^JO-fr/feVf; <* a 0) 

where the factorial has been replaced by the gamma function, which has an analytic 
continuation into the complex domain for non-integer and non-positive values of its 
argument. The fractional derivative corresponding to the fractional integral in (1) is given 
by 

JL d \°~) (2) 

dt n 

where [a\ +1 > n > [a] and the bracket denotes the integer value n closest to a. 
Consequently for a<M2 we have n = 0. Equation (1) is the Riemann-Liouville (5L£) 
formula for the fractional operator; it is the integral operator when a < 0 and it is the 
differential operator interpreted as (2) when a > 0. 


2.1 Derivative of a fractal function 

Richardson, in his 1926 investigation of turbulence, observed that the velocity field of the 
atmospheric wind is so erratic that it probably cannot be described by an analytic 
function 16 . He suggested a Weierstrass function as a candidate to represent the velocity 
field, since the function is continuous everywhere, but nowhere differentiable, properties 
he observed in the wind-field data. Here we investigate a generalization of the 
Weierstrass function in order to simplify some of the discussion 

>r(t)= E^-cosMI (3) 

under the conditions that b>a>l. Note that the time derivative of (3) yields a series in 
which the successive terms increase by a factor of b/a>l and therefore diverges. The 
generalized Weierstrass function (GWF) satisfies the scaling relation 
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W(bt)=aW(t), (4) 

resulting from a simple shift of the index n in the summation. Equation (4) has the form 
of a renormalization group scaling relation 5 , which can be solved by assuming a solution 
of the form 


H>)= f>"’ (5) 

Inserting (5) into (3) yields the equation for the scaling index 


In a .27m 
fab~ l h[b ’ 


( 6 ) 


where the scaling exponent is seen to be complex. This exponent has been related to a 
complex fractal dimension in the architecture of the human lung 17 , in many other 
physiological systems 4,5 , as well as in earthquakes, turbulence and financial crashes 18 . 

The GWF is a superposition of harmonic terms having increasing frequencies as 
powers of b with decreasing amplitudes as powers of 1/a. This function has a fractal 
dimension D if we choose a = b 2 ' D , so that in terms of the fractal dimension we write the 
GWF as 


< 7 > 

The SUE -fractional integral of the GWF is given by 

0' , '“ ) (')--„A w [»'(')]= <8) 

for 0 < a < 1, which after some not so straightforward analysis 4 ’ 19 yields 

W ( ~ a) {t) = £ 6 ( 2 _L) - „ [l - cos (b n t)] (9) 

Similarly the 9L£ -fractional derivative of the GWF is given by 

00 ) 

for 0 < a < 1, which integrates to 4,20 

W {a) {t)= 2 6 ( 2 -L)„ [l-cos(6"f)]. 


( 11 ) 
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Consequently, we see that the fractional integral shifts the fractal dimension 
D —» D - a and the fractional derivative shifts the fractal dimension D —» D + a . 

These results can be interpreted by noticing that the fractional dimension gives 
information about the degree of irregularity of the function under analysis. Carrying out a 
fractional integral of the GWF implies decreasing its fractional dimension and therefore 
smooths the process, whereas carrying out the fractional derivative means increasing the 
fractional dimension and therefore making the process and its increments more irregular. 
What is most intriguing is the fact that a fractional operator acting on a fractal function 
yields another fractal function, the derivative does not diverge, as does an ordinary 
derivative of a fractal function, like that of Weierstrass. This suggests that the fractional 
calculus is the appropriate method for characterizing the dynamics of complex 
phenomena, particularly those that are described by fractal functions. 


2.2 Fractional Brownian motion 

It is possible to extend our discussion of GWF to random processes by including random 
phases in the definition 

r(r) = Re||;d r [l-e'‘ , '] e ''‘-} (12) 

where the phase is a random quantity uniformly distributed on the interval (0,2^). 
Equation (12) would be one way to introduce a random function that has the desired 
scaling properties and we could discuss the dynamics of this process in time using the 
fractional operators. An alternative approach is to start with continuous functions and that 
is what we do now. Consider a function defined by the Fourier transform 

\~ iat i{co)do . (13) 

in 

Operating on this function with the £L£-ffactional operator, with a lower limit of negative 
infinity, defines a new function 

Fjf K»A ( ' a) [#(0] = ]e ,r,>, (-io))' a i{(a)doj (14) 

and the weighting in the integrand is obtained by operating on the exponential in the 
Fourier transform D\~ a ^\e‘“’ t J = e“°‘ {i(o) “. If we now interpret the function (13) as 

a stochastic quantity, then we can evaluate the correlation of the function (14) at two time 

points separated by a time interval T 
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( FjfY a (t + t)) ( 


\dm x 


W) # 


(15) 


where the brackets denote an average over an ensemble of realizations of random 
fluctuations. If the random fluctuations correspond to a Wiener process the average in the 
integrand reduces to 

=CS(a >, -od 2 ) (16) 

and C is a constant. Substituting (16) into (15) and integrating over one of the frequencies 
yields for the autocorrelation function 

( F a {t)K {t + r)) e = ]d0)e iaT 0)- 2a oc r 2a ~ l . (17) 

If we make the association of the order of the fractional operator with the Hurst exponent 

a = H-1/2 (18) 

we observe that the fractional index lies in the interval —l/2<Ct<l/2, because the 
Hurst exponent is confined to the interval 0 < H < 1. Therefore the solution to the 
fractal stochastic equation of motion 

-A l " ) fc(')]=f( t) (19) 

given by (14) is a colored noise representation of the dynamics expressed by (19). The 
integral relation in (14) is linear so that the solution F a (t) and the random fluctuations 
€(t) have the same statistics, which, by assumption, are Gaussian. Consequently the 
solution F a (/) is a realization of fractional Brownian motion with the fractional index 
restricted to the indicated region. 

3. Fractional Langevin equations 

Of course, the fractional calculus does not in itself constitute a physical/biological theory, 
but requires such a theory in order to interpret the fractional derivatives and integrals in 
terms of physical/biological phenomena. We therefore follow a pedagogical approach 
and examine the simple relaxation process described by the rate equation 

—<D(f) + 2O(f) = 0 (20) 

dt 

where t > 0 and the relaxation rate X determines how quickly the process returns to its 
equilibrium state. The solution to (20) is given by 0(/) = O(0)e“ ;ir which is unique in 
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terms of the initial condition ®(0). An alternative way of writing (20) is in terms of the 
anti-derivative operator 

o(»)-0(0)=^ o(0 

which suggests, for its generalization, replacing the anti-derivative with the 9L£ - 
fractional integral operator 

a>(f)-O(0) = ^ 0 A ( -“ ) [<D(f)] (21) 


where the lower limit of the fractional integral is zero, corresponding to the initial value 
problem. Operating on the left in (21) with the fractional derivative we obtain the 
generalization to the relaxation equation given by 21 


0 D, w [o(0]+ro(0 = 


r“o(o) 

r(i-«) 


( 22 ) 


and the initial value becomes an inhomogeneous term in this fractional relaxation 
equation of motion. Here relaxation time is raised to the power a > 0 in order to 
maintain the correct dimensionality. 

Equations of the form (22) are mathematically well defined, and strategies for 
solving such equations have been developed by a number of investigators, particularly in 
the book by Miller and Ross 22 that is devoted almost exclusively to solving such 
equations when the index is rational. Here we make no such restriction and consider the 
Laplace transform of (22) to obtain 


®W = 


P(0) S" 
s A a + s a 


(23) 


whose inverse Laplace transform is the solution to the fractional differential equation. 
Inverting Laplace transforms such as (23) is non-trivial and an excellent technique that 
overcomes many of the technical difficulties, implemented by Nonnenmacher and 
Metzler 23 , involve the use of Fox functions 13 . The solution to the fractional relaxation 
equation is given by the series expansion for the standard Mittag-Leffler function 

®(') = 0(0 )£.(-(*?)= 4> (o)Z 

which in the limit a —> 1 yields the exponential function 




( 24 ) 
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as it should, since under this condition (22) reduces to the ordinary relaxation rate 
equation (21). 

The Mittag-Leffler function has interesting properties in both the short-time and 
the long-time limits. In the short-time limit it yields the Kohlrausch-Williams-Watts Law 
for stress relaxation in rheology given by 

lim E a {-(At) a )=e iMY (25) 

also known as the stretched exponential. In the long-time limit it yields the inverse power 
law, known as the Nutting Law, 

lim£ a (-(/l/)“ )= {fa) a ■ ( 26 ) 

Figure 1 displays the Mittag-Leffler function as well as the two asymptotes, the dashed 
curve being the stretched exponential and the dotted curve the inverse power law. What is 
apparent from this discussion is the long-time memory associated with the fractional 
relaxation process is inverse power law rather than the exponential of ordinary relaxation. 
It is apparent that the Mittag-Leffler function smoothly joins these two empirically 
determined asymptotic distributions. 



Figure 1: The solid curve is the Mittag-Leffler function, the solution to the fractional 
relaxation equation. The dashed curve is the stretched exponential (Kohlrausch-Williams- 
Watts Law) and the dotted curve is the inverse power law (Nutting Law). 
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We can now generalize the fractional differential equation to include a random force 
<^(t) and in this way obtain a fractional Langevin equation 

o DW[®(f)]+r®(0 = ^^ + f((). (27) 

The solution to this equation is obtained using Laplace transforms as done previously 

(28) 

Note the difference in the ^-dependence of the two coefficients of the right-hand side of 
(28). The inverse Laplace transform of the first term yields the Mittag-Leffler function as 
found in the homogeneous case above. The inverse Laplace transform of the second term 
is the convolution of the random force and a stationary kernel. The kernel is given by the 
series 

fpb) ,a>M>0 - (29) 

which is the generalized Mittag-Leffler function. The function defined by (29) reduces to 
the usual Mittag-Leffler function when /? = 1, so that both the homogeneous and 
inhomogeneous terms in the solution to the fractional Langevin equation can be 
expressed in terms of these series. 

Note that taking the average value of (27) and observing that the average of the 
random force is zero, we obtain 

.4“ ) N0)]+*<«K')) = ^| (30) 

which is clearly of the form of the fractional stress relaxation equation. The average 
response of the system is determined by the Mittag-Leffler function, which is to say, the 
average has a long-time memory (inverse power law). 

The explicit inverse of (27) yields the solution 13 

«>(') = ®(0)E„ (- W )+ )(t - tT'E a „ (- (Mf (31) 

0 

In the case a = 1, the Mittag-Leffler function becomes the exponential, so that the 
solution to the fractional Langevin equation reduces to that for an Omstein-Uhlenbeck 
process 
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4>(f)= 0(0>T* + 


(32) 


as it should. The analysis of the autocorrelation function of (31) can be quite daunting 
and so we do not pursue it further here, but refer the reader to the literature 13 ’ 24 . A 
somewhat simpler problem is the fractional Langevin equation without dissipation. 

Consider the second moment of the solution to the Langevin equation when 

X — 0 giving rise to 


(NO-<J>(0)M 2 )-^(0)]> = )dh )dr 2 , ( tf J> V -« ’ ( 33 ) 

Here again we take the random force to have Gaussian statistics and to be delta correlated 
in time 

(f( r >k(*2 )) = CSfa -t 2 ). (34) 

Inserting (34) into the expression for the autocorrelation function (33) and noting that the 
integral is symmetric in the times, the delta function restricts the integration to the lesser 
of the two times, so introducing the notation for the lesser time i< and greater time t> we 
obtain 13 

([©(<,)-O(0)I<J>(r,)-®(0)]> = ^ 2 lr|l;l-a;l + a:Lj (35) 


in terms of the hypergeometric function. Note that although the statistics of the solution 
are Gaussian, they are also non-stationary, since the autocorrelation function depends on 
the lesser and the greater times separately and not on their difference. 

Of course, we can also use the general expression (35) to write the second 
moment of the solution at time t =t < =t > . 


(NO-«>(o)T} = 7or- F ( 1;1 + “ : 1) 

2 Ct 2a ~ l 

~ (2a-l)r(af 


(36) 


where the second equality results from writing the hypergeometric function as the ratio of 
gamma functions. The time dependence of the second moment (36), if we make the 
identification 2H =2cc — 1, and the fractional index is less than one we have 
1 / 2 > H > 0. Consequently, the anomalous diffusion process described by the 
dissipation-free fractional Langevin equation is antipersistent. 
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This antipersistent behavior of the time series was observed by Peng et al. 25 for 
the differences in time intervals between heart beats. They interpreted their result, as did 
a number of subsequent investigators, in terms of random walks with H < 1/2. However, 
we can see from (36) that the fractional Langevin equation without dissipation is an 
equally good, or one might say an equivalent, description of the underlying dynamics. 
The scaling behavior alone cannot distinguish between these two models, what is needed 
is the complete statistical distribution and not just the time-dependence (scaling behavior) 
of a central moment. 


3.1 Physical/physiological models 

A physical Langevin equation is generally constructed from a Hamiltonian for a simple 
dynamical system coupled to the environment. The equations of motion for the coupled 
system are manipulated so as to eliminate the degrees of freedom of the environment 
from the dynamical description of the system. Only the initial state of the environment 
(heat bath) remains in the Langevin description, where the random nature of the driving 
force is inserted through the choice of distribution of the initial states of the heat bath. 
The simplest Langevin equation for a dynamical system open to the environment has the 
form 

^ + = ( 37 ) 

where £(t) is a random force, X is a dissipation parameter and there exists a fluctuation- 
dissipation relation connecting the two 26 . Of course we can not completely interpret (37) 
until we specify the statistical properties of the fluctuations and for this we need to know 
the environment of the system. The random force is typically assumed to be a Wiener 
process, that is, to have Gaussian statistics and no memory. 

When the system dynamics depends on what occurred earlier, that is, the 
environment has memory, (37) is no longer adequate and the Langevin equation must be 
modified. The generalized Langevin equation takes this memory into account through an 
integral term of the form 

^ + )K{t-t')x{t')dt'= £(t) ( 38 ) 

where the memory kernel replaces the dissipation parameter and the fluctuation- 
dissipation relation becomes generalized 

*M=(f(' +r k(')). 


( 39 ) 
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Both Langevin equations (37) and (38) are monofractal if the fluctuations are 
mono fractal, which is to say, the time series given by the trajectory X(t) is a fractal 
random process if the random force is a fractal random process. 

However, neither of these models is adequate for describing multifractal 
statistical processes as they stand. A number of investigators have recently developed 
multifractal random walk models to account for the multifractal character of various 
physiological phenomena and here we introduce a variant of those discussions based on 
the fractional calculus. The most recent generalization of the Langevin equation 
incorporates memory into the system’s dynamics and has the simple form of (27) with the 
dissipation parameter set to zero 

=#(')• ho) 

The fractional Langevin equation (40) was obtained by Lutz 27 for a free particle coupled 
to a fractal heat bath, when the inertial terms is negligible. The formal solution to 
fractional Langevin equation (40) is 




i V SVW 
r 0 -b)h-tT* 


which can be expressed in terms of the integral kernel 


AX(l),X(t)-X 0 = 


The form of relation (41) for multiplicative stochastic processes and its association with 
multifractals has been noted in the phenomenon of turbulent fluid flow 28 , through a 
space, rather than time, integration kernel. 

The random force term on the right-hand side of (41) is selected to be a zero- 
centered, Gaussian random variable and therefore to scale as 29 

(42) 

where the Hurst exponent is in the range 0 < H < 1. In a similar way the kernel in (41) is 
easily shown to scale as 

K fl {M) = X‘K M {t), (43) 

so that the solution to the fractional Langevin equation scales as 

AX(At) = A H+ "AX(t). 


( 44 ) 
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In order to make the solution to the fractional Langevin equation a multifractal we 
assume that the parameter p is a random variable. To construct the traditional measures of 
multifractal stochastic processes we calculate the q‘ moment of the solution (44) by 
averaging over both the random force and the random parameter to obtain 

(|aa p (/?/)| ? \ 

f (45) 

={| a x(ty)x M 

The scaling relation in (44) determines the q‘ h order structure function exponent q(q). 
Note that when q (q) is linear in q the underlying process is monoffactal, whereas, when it 
is nonlinear in q the process is multifractal, because we can relate the structure function 
to the mass exponent 30 

g{q)=2-r(q). (46) 

Consequently we have that q (0) = H so that t (0) = 2-H, as it should because of the well 
known relation between the fractal dimension and the global Hurst exponent D 0 = 2 -H. 

To determine the structure function exponent we make an assumption about the 
statistics of the parameter p. We can always write the p-average as 



where Z(lnX) is the random variable. In this way the expression on the right-hand side of 
(47) is the Laplace transform of the probability density. We assume the random variable 
is a a-stable Levy process in which case the statistics of the multiplicative fluctuations 
are given by the distribution 

p(x,s)=— f e ik2 e- bsW “ dk (48) 

In 

with 0 < a < 2. Inserting (48) into (47) and integrating over z yields the delta function 
5(k+iq) which, integrating over k, results in 

^zM)^ = e -%l“ ln ^ = ;f%r (49) 

so that comparing this result with (45) we obtain for the structure function exponent 

g{q) = (q + \)H-b\q\ a . (50) 

Therefore the solution to the fractional Langevin equation corresponds to a monofractal 
process only in the case a = 1 and q > 0, otherwise the process is multifractal. We restrict 
the remaining discussion to positive moments. 
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Thus, we observe that when the memory kernel in the fractional Langevin 
equation is random, the solution consists of the product of two random quantities giving 
rise to a multifractal process. This is Feller’s subordination process. We apply this 
approach to the stride interval time series depicted in Figure 2a. 

Walking consists of a sequence of steps and the corresponding time series is made up of 
the time intervals for these steps. A stride interval, or step length, is the length of time 
from the one heel strike to the next heel strike of the same foot. It is the variability in the 
time series made from these intervals that is probed in our analysis of the stride interval 
time series. We refer to this variability as stride rate variability (SRV). We observe, using 
the SRV time series, that for the statistics of the multiplicative exponent given by Levy 
statistics, the singularity spectrum as a function of the positive moments shown in Figure 
2b. 

The solid curve in Figure 2b is obtained from the analytic form of the singularity 
spectrum 

f{q)=2-H-(cc-\)bq a , (51) 

obtained by substituting the structure function exponent into the expression relating the 
structure function to the ^-dependent mass exponent f{c[) = qh + r(^). It is clear from 
Figure 2 that the data for the singularity spectrum are well fit by a solution to the 
fractional Langevin equation with the parameters for the Levy distribution given by a = 
1.45 and b = 0.1, obtained through a mean-square fit of (51) to the singularity spectrum 
determined by the SRV time series data. 
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Figure 2: (a)The time interval between strides for the first 500 steps made by a typical 
walker in an experiment is depicted.(b) The singularity spectrum for q > 0 obtained 
through the numerical fit to the human gait data. The curve is the average over the ten 
data sets obtained in the experiment 31 . 


Of course, different physiologic processes generate different fractal time series, 
because the long-time memory of the underlying dynamical processes can be quite 
different. Physiological signals, such as cerebral blood flow (CBF), are typically 
generated by complex self-regulatory systems that handle inputs with a broad range of 
characteristics. Ivanov et al. 32 established that healthy human heartbeat intervals, rather 
than being fractal, exhibit multifractal properties and uncovered the loss of multifractality 
for a life-threatening condition of congestive heart failure. West et al. 33 similarly 
determined that CBF in healthy humans is also multifractal and this multifractality is 
severely narrowed for people who suffer from migraines. 
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Figure 3: Middle cerebral artery flow velocity time series for a typical healthy subject 33 . 

Migraine headaches have been the bane of humanity for centuries, afflicting such 
notables as Caesar, Pascal, Kant, Beethoven, Chopin and Napoleon. However, its 
etiology and pathomechanism have to date not been satisfactorily explained. It was 
demonstrated 33 that the characteristics ofCBF time s eries s ignificantly differs between 
that of normal healthy individuals and migraineurs. Transcranial Doppler 
ultrasonography (TCD) enables high-resolution measurement of middle cerebral artery 
blood flow velocity. Like heart rate variability HRV, stride rate variability SRV and 
breathing r ate v ariability B RV t ime series d ata, t he t ime series o f c erebral b lood flow 
velocity consists of a sequence of waveforms. These waveforms are influenced by a 
complex feedback system involving a number of variables, such as arterial pressure, 
cerebral vascular resistance, plasma viscosity, arterial oxygen and carbon dioxide 
content, as well as other factors. Even though the TCD technique does not allow us to 
directly determine CBF values, it helps to clarify the nature and role of vascular 
abnormalities associated with migraine. In particular we present the multifractal 
properties of human middle cerebral artery flow velocity, an example of which is 
presented below in Figure 3. 

In Figure 4 we compare the multifractal spectrum for middle cerebral artery 
blood flow velocity time series for a healthy group of five subjects and a group of eight 
migraineurs 33 . A significant change in the multifractal properties of the blood flow time 
series is apparent. Namely, the interval for the multifractal distribution on the local 
scaling exponent is greatly constricted. This is reflected in the small value of the width of 
the multifractal spectrum for the migraineurs 0.013, which is almost three times smaller 
than the width for the control group 0.038 for both migraineurs with and without aura. 
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The distributions are centered at 0.81, the same as that of the control group, so the 
average scaling behavior would appear to be the same. 
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Figure 4: The average multifractal spectrum for middle cerebral blood flow time series is 
depicted by f(h). (a) The spectrum is the average of ten time series measurements from 
five healthy subjects (filled circles). The solid curve is the best least-squares fit of the 
parameters to the predicted singularity spectrum, (b) The spectrum is the average of 14 
time series measurements of eight migraineurs (filled circles). The solid curve is the best 
least-squares fit to the predicted spectrum using (53). 

However, the contraction of the spectrum suggests that the underlying process has lost its 
flexibility. The biological advantage of multifractal processes is that they are highly 
adaptive, so that in this case the brain of a healthy individual adapts to the multifractality 
of the interbeat interval time series. We see that disease, in this case migraine, may be 
associated with the loss of complexity and consequently the loss of adaptability, thereby 
suppressing the normal multifractality of cerebral blood flow time series. Thus, the 
reduction in the width of the multifractal spectrum is the result of excessive dampening of 
the cerebral flow fluctuations and is the manifestation of the significant loss of 
adaptability and overall hyperexcitability of the underlying regulation system. West et 
al. 33 emphasize that hyperexcitability of the CBF control system seems to be 
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physiologically consistent with the reduced activation level of cortical neurons observed 
in some transcranial magnetic simulation and evoked potential studies. 

Regulation of CBF is a complex dynamical process and remains relatively 
constant over a wide range of perfusion pressure via a variety of feedback control 
mechanisms, such as metabolic, myogenic, and neurally mediated changes in 
cerebrovascular impedance respond to changes in perfusion pressure. The contribution to 
the overall CBF regulation by different areas of the brain is modeled by the statistics of 
the fractional derivative parameter, which determines the multifractal nature of the time 
series. The source of the multifractality is over and above that produced by the 
cardiovascular system. 

The multifractal nature of CBF time series is here modeled using a fractional 
Langevin model. We again implement the scaling properties of the random force and the 
memory kernel to obtain (51) as the scaling of the solution to the fractional Langevin 
equation. Here when we calculate the q moment of the solution we assume Gaussian, 
rather than the more general Levy, statistics. Consequently we obtain the quadratic 
function for the singularity spectrum 

f(q)=2-H-bq 2 (52) 

which can be obtained from (51) by setting a = 2. Another way to express (52) is 

f(h)=f(H)~(h-HY (53) 

where we have used the fact that the fractal dimension is given by 2-H which is the value 
of the function at h = H. 

It seems that the changes in the cerebral autoregulation associated with migraine 
can strongly modify the multifractality of middle cerebral artery blood flow. The 
constriction of the multifractal to monofractal behavior of the blood flow depends on the 
statistics of the fractional derivative index. As the distribution of this parameter narrows 
down to a delta function, the nonlocal influence of the mechanoreceptor constriction 
disappears. On the other hand, the cerebral autoregulation does not modify the 
monofractal properties characterized by the single global Hurst exponent, presumably 
that produced by the cardiovascular system. 

4. Summary, conclusions and speculations 

Scaling suggests that the historical notion of disease, which has loss of regularity at its 
core, is inadequate for the treatment of dynamical diseases. Instead of loss of regularity, 
we identify the loss of variability with disease, so that a disease not only changes an 
average measure, such as stride rate, which it does in late stages, but is manifest in 
changes in stride rate variability at very early stages. Loss of variability implies a loss of 



physiologic control and this loss of control is reflected in the change of fractal dimension, 
that is, in the scaling index of the corresponding time series 34 . 

The proper operation of physiologic processes is manifest through the scaling of 
appropriate time series. A measured function denoted by X(t) is said to be homogeneous 
when the time axis being scaled by a constant y yields the original function modified by 
an overall scale X(yt)= X(t)/f. This scaling behavior generalizes to time series when the 
measured function is stochastic and the scaling relation is interpreted in terms of the 
probability density function rather than the dynamic function itself. 

We discussed how the fractional calculus could embody a number of the 
properties so prevalent in physiologic phenomena, not the least of which being that the 
evolution of a fractal processes can be described by a fractional differential equation. We 
showed that the evolution of fractal stochastic process can be described by a fractional 
Langevin e quation i n which a fractional d ifferential e quation i s d riven b y a s tochastic 
force. In particular, we demonstrated that the fractional calculus could provide a 
description of the dynamics o f an anomalous diffusion process in which the long-time 
memory is not part of the stochastic driver, as it was in earlier models, but is actually part 
of the system’s non-local dynamics through the fractional derivatives. The multifractal 
character of certain physiological time series, such as gait and cerebral blood flow, is 
described by fractional Langevin equations with random indices. The multifractal 
spectrum is shown to be related to the statistical properties of these random indices. 

The well being of the body’s system-of-systems is measured by the fractal 
scaling properties of the various dynamic subsystems and such scaling determines how 
well the overall complexity is maintained. Once the perspective that disease is the loss of 
complexity has been adopted, the strategies presently used in combating disease must be 
critically examined. Life support equipment is one such strategy, but the tradition of such 
life support is to supply blood at the average rate of the beating heart, to ventilate the 
lungs at their average rate and so on. So how does the new perspective regarding disease 
influence the traditional approach to healing the body? 

Alan Mutch, of the University of Manitoba, argues that both blood flow and 
ventilation are delivered in a fractal manner in both space and time in a healthy body. 
However, during critical illness, conventional life support devices deliver respiratory 
gases by mechanical ventilation or blood by cardiopulmonary bypass pump in a 
monotonously periodic fashion. This periodic driving overrides the natural aperiodic 
operation of the body. Mutch speculates that these devices result in the loss of normal 
fractal transmission and consequently may do more damage the longer they are 
required 35 . Disease as the 1 oss of complexity is consistent with the view that complex 
phenomena have a multiplicity of failure modes. These failure modes result in 
phenomena changing character, invariably becoming simpler with an accompanying 
inability to carryout their function. A cascade of failures is not so much a consequence of 
the initiating event, as it is the result of the state of the network when the event is initiated 

A number of scientists 36 have demonstrated that the stability of hierarchal 
biological systems is a consequence of the interactions among the elements of the system. 
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Furthermore, there is an increase in stability resulting from the nesting of systems within 
systems - organelles into cells, cells into tissue, tissues into organs and so on up from the 
microscopic to the macroscopic. Each system level confers additional stability on the 
overall fractal structure. The fractal nature of the system suggests a basic variability in 
the way systems are coupled together. For example, the interaction between cardiac and 
respiratory cycles is not constant, but adapts to the physiologic challenges being 
experienced by the body. 

We conclude with a number of observations: 1) The empirical evidence 
overwhelmingly supports the interpretation of the time series analysis that complex 
physiologic phenomena are described by fractal stochastic processes. Furthermore, the 
fractal nature of these time series is not constant in time but change with the vagaries of 
the interaction of the system with its environment and therefore these phenomena are 
multifractal. 2) The scaling index or fractal dimension marks the system’s responsive and 
can be used as an indicator of the system’s state of health. Since the fractal dimension is 
also a measure of the level of complexity, the change in dimension with disease suggests 
a new definition of disease as a loss of complexity, rather than the loss of regularity 34 . 3) 
The fractal dynamics of complex physiologic systems can be modeled using the 
fractional rather than the ordinary calculus because the changes in the fractal functions 
necessary to describe physiological complexity remain finite in the fractional formalism, 
but diverge in the traditional formalism 10 . 
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1. Introduction: statement of the problem and notations 

The classical phenomenon of relaxation in its simplest form is known to be governed 
by a linear ordinary differential equation of order one, possibly non-homogeneous, 
that hereafter we recall with the corresponding solution. Denoting by t > 0 the 
time variable, u = u(t) the field variable, and q[t) a given continuous (or, more gen¬ 
erally, integrable) function, that represents the possible forcing term, the relaxation 
differential equation (of non-homogeneous type) reads 

u'(t) = -\u(t) + q(t) , t > 0, A > 0, (1) 

where A is a positive constant denoting the inverse of some characteristic time of 
the problem. The solution of (1), under the initial condition u(0 + ) = Co , is 

u(t) = co e — ^ + [ q(t — t) e~^ T dr t > 0. (2) 

Jo 

Such solution can be re-written as 

u(t) = Cq u 0 (t ) + {u s * q) ( t ), u 0 {t ) = e - ^ , u s (t ) = e - ^ = ~ u' 0 (t). (3) 
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Here the function Uo(t) represents the fundamental solution, namely the solution of 
the homogeneous equation which satisfies the initial condition uo(0 + ) = 1, and the 
function ug(t) , with which the free term q(t) appears convoluted, represents the so 
called impulse-response solution, namely the particular solution of the inhomoge¬ 
neous equation with Co = 0 and with q(t) = S(t). 

Prom the view-point of fractional calculus a natural generalization of equation 
(1) is obtained by replacing the ordinary derivative of order 1 with a fractional one 
of order 0 G (0, 1) , 

u^\t | = —A u(t) + q(t) t> 0, A>0, 0 < /? < 1, (4) 


subjected to the initial condition u(0 + ) = Co. In order to preserve the type of initial 
condition required in the classical phenomenon, the fractional derivative is meant 
in the Caputo sense, defined as follows according to three equivalent forms, 


uV\t) = 


_i_ r^± dT 

r(i - P) Jo (t — t)p aT ’ 

_I_ If < r ) dT 1 0 

r(i — /?) dtJo {t-rY r(i - 0) 

1 £ f t u{T)-u{0 + ) 

. r(l — /?) dtJo (t — t)P a ' 


U(0+), 


0 < 0 < 1 . 


(5) 


In the limit 0 = 1 the Caputo derivative is known to reduce to the first derivative, 
but for 0 = 0 we find u(t) - u(0 + ). 

For later use let us recall the following rule in the Laplace transform domain 
that can be used as the starting point to properly define the Caputo fractional 
derivative: 


f{#(l);^=/ii(i)-^- 1 «(0 + ), 0 < /3 < 1, 3fc>0, ( 6 ) 


where u(s) denotes the Laplace transform of u(t). 

We agree to refer to the equation (4) as the simple fractional relaxation equation. 
The reader interested to have more details on this topic may consult our review 
paper L For treatises on fractional calculus we refer e.g. to 2,3,4 . 

The simple fractional relaxation equation can be generalized by using the notion 
fractional derivative of distributed order*. We thus consider the so-called distributed 
order fractional relaxation equation or fractional relaxation equation of distributed 
order, 


f b(0) u (/3) (f) d0 = —Xu(t) -I- q(t), 
Jo 


(7) 


a We find a former idea of fractional derivative of distributed order in time in the 1969 book by 
Caputo 5 , that was later developed by Caputo himself, see 6,7 and by Bagley & Torvik, see 8 . 
A basic framework for the numerical solution of distributed-order differential equations has been 
recently introduced by Diethelm &; Ford 9 . 
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subjected to the usual initial condition u(0 + ) = Co, where 

b{/3)> 0, and f 6(/3)d/J=l. (8) 

Jo 

The normalization condition for the integral is here assumed for convenience but 
it is not mandatory. Clearly, some special conditions of regularity and behaviour 
near the boundaries will be required for the weight function b{(3). which, however 
is allowed to have 5 components. 

Being (4) and (7) linear non-homogeneous equations, though not of differential 
type like (1), it is easy to show the validity of the decomposition of their solutions 
into the two basic solutions, the fundamental solution uo(t) and the impulse response 
solution ug(t), that will no longer be of exponential type. 

The purpose of this paper is to provide some preliminary results on the basic 
solutions of (7) both in general and in some special cases, results that are based on 
the application of the Laplace transformation. The plan of the paper is as follows. 

In Section 2, by using the Laplace transform, we provide some relevant properties 
of the basic solutions uo{t) and Us(t) for the general case, namely properties that are 
independent from the choice of the weight function &(/?). In Section 3 we consider 
a few typical examples of weight functions b(0), thereby concentrating our interest 
on the behaviour of Uo(t) and ug{t) near zero and near infinity by using Tauberian 
theory. We note that finding explicit solution formulas rarely is possible. Finally, 
concluding remarks and directions for future work are given in Section 4. 


2. Complete monotonicity of the basic solutions 

Let us now apply the Laplace transform to Eq. (7) by using the rule (6) and 
introducing the relevant function 

B(s) = C b{0) df3 . (9) 

Jo 

We then get 

B(s ) u(s) - co = -A u(s) + q(s ), 

namely 


u(s) = co tZo(s) + u s (s) q(s ), (10) 

where 

So(s) = s ' w = XtW (11) 

So the decomposition of the solution of the fractional relaxation equation of dis¬ 
tributed order (7) into the two basic solutions is obtained in analogy with the the 
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classic relaxation equation (1), see the L.H.S of (3). The relation between these 
solutions, see the R.H.S of (3), is also verified. In fact, from the identity 
A B(s) 

A + B(s) A + JB(s) ’ 

and using (11) we have, 

««(*) = (s«o(s) - 1) , (12) 

hence, noting tto(0 + ) = 1, 

Mt) = ~ju' 0 (t ), (13) 

like for the standard relaxation equation (1). 

We are now going to show that the basic solutions uo{t) and ug(t) f thanks to the 
conditions (8), are both completely monotone , so keeping the fundamental property 
of the corresponding basic solutions of the standard relaxation equation (1). 

We recall that a function f(t) defined for t > 0 is said to be completely monotone 
(CM ) if it is a non-negative with infinitely many derivatives that alternate in sign. 
In other words 

(_1)n fSr /W - 0, n = 0,1,2,... , t > 0. (14) 

A necessary and sufficient condition is given by Bernstein’s theorem, according to 
which a function f(t) is CM in R + if and only if it is the restriction to the positive 
real semi-axis of the Laplace transform of a positive measure. For sake of simplicity 
we agree to represent /(f) as 

f(t)= f e~ rt p(r ) dr , p(r)>0, (15) 

Jo 

where p(r) is a non-negative (ordinary or generalized) function. Furthermore, a 
function g(t ) defined for t > 0 is said to be a Bernstein function if it is non-negative 
and its first derivative is a CM function. In other words 

9(t)> 0, (-l) n-1 |^(t)>0, n = 1,2,... , t > 0. (16) 

Thus the CM and Bernstein functions are special non-negative functions defined 
on the positive real semi-axis, the former being decreasing and convex, the latter 
increasing and concave. Relevant examples are the functions of exponential type, 
like f(t) = e _t and g(t) = 1 — e -t , correspondingly. For more details on these 
classes of functions we refer e.g. to 10 ’ 11 ’ 12 , where the reader can find a rigorous and 
exhaustive treatment. A more practical approach to this matter can be found in 13 , 
from which we recall the following result, a sort of inverse of Bernstein’s theorem: 
The inverse Laplace transform of a CM function is non-negative. 

Let us now prove that the basic solutions u 0 (t) and u&(t.) are CM functions. Let 
us first show that they are non-negative (as we naturally expect), as a consequence 
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of the above theorem. Looking into §9, Ch. II of 10 we are led to the following 
observations: 

B(s) = I b(P) s 0 dp is Bernstein function because so is the function s' 3 for s > 0; 
B(s)/s= f b{fi) .s^ 1 dp is CM function because so is the function ,s a_1 for s > 0; 

Jo 

us(s ) = 1/[A + jB(s)] is CM function, because it is reciprocal of a Bernstein function; 
uq(s) = 5(.s)/{.s[A + B(s)]} is CM function, because it is product of two CM 
functions. 

As inverse Laplace transforms of CM functions, the basic solutions uo{t) and u$(t) 
are thus non-negative. 

Are they completely monotone? To answer this question we invoke the Titch- 
marsh theorem on Laplace inversion. We observe the fact, that for 0 < P < 1 the 
functions s 0-1 and s' 3 are regular in the main sheet of the Riemann surface (the 
complex plane cut along the negative real semi-axis), and that in particular for any 
fi > 0 the functions )i + s 0 never vanish there on the negative real semi-axis itself. 
Hence, if &(/?) does not contain 5-like contribution at P — 0 or p = 1, we have 


u 0 (t) = -- J e 

rt Im {«o (re™) } dr , 

(17) 

MV = -~ / e 

7T Jo 

~ rt Im {us (re™) } dr , 

(18) 

and, according to the expressions of uq(s) and us(s) in (11), we must look for the 

sign of 



1A + B(s) / 

and - Im i -—- n . . \ 

\ A + B(s) / 


along the ray s = re in , r > 0. 



For the second of these expressions 

we have 


1 

A + B(s) 


A + B(s) ' 

|A + H(s )| 2 ’ 


so only the sign of -Im jfi(s) j along & 

: = re™ is relevant. We have 


-Imjy b(p)r 0 e™ 0 dp\j 

= [ b(p) r 0 s\n(nP) dp > 0 . 

Jo 

(19) 

Hence, us(t) is completely monotone, a 
tion. 

s Laplace transform (18) of a positive 

func- 

Concerning the first expression, we 

observe 


B(s) 

B(s)[\ + B(s)] 


s[X + B(s)) 

s|A + H(s)| 2 ’ 
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so only the signs of -Im{B(s)/s} and -Im{l/s} along 5 = re in are relevant. 

Clearly, -1 /(re™) = 1/r > 0. and from B(s)/s = [ b((3)s f} ~ 1 dt3 we conclude that 

Jo 

-Imj J b(P)r p ~ 1 dp^ = J b(p) r^ -1 sin(7r/3) d/3 > 0. (20) 

Hence, uo(t) is completely monotone, as Laplace transform (17) of a positive func¬ 
tion. Considering equations (13) and (14) we again see that also the function Us(t) 
is completely monotone. 


3. Examples 


Let us consider some typical choices for the weight function b(P) that characterizes 
the relaxation equation of distributed order. Since finding explicit solution formulas 
may be possible only in a few cases we shall concentrate our interest on the asymp¬ 
totic behaviour of uo(t) and us(t) as t —> 0 and t —> +00 by using the Tauberian 
theory for Laplace transforms. According to this theory the asymptotic behaviour 
of a function f(t ) near t = 00 and t = 0 is (formally) obtained form the asymptotic 
behaviour of its Laplace transform f(s ) for s -* 0 + and for s —> + 00 , respectively. 
For the application of this theory we limit ourselves to consider the behaviour of 
u 0 (t) since for us(t) we may apply the differential relationship (12). Furthermore 
we shall use the asymptotic representations 


u Q {s) = 


B(s)/s 
A 4- B(s) 


1 B(s) 

A . S ’ . 

- [ 1_ 


0+ , being B(s) « A, 
+ 00 , being B(s) » A. 


( 21 ) 


3.1. The single-order fractional relaxation 

The choice 


&(/?) = 8(P - Pi ), with 0 < pi < 1 (22) 

corresponding to the simple fractional relaxation equation has been exhaustively 
treated in our 1997 review paper 1 , see also 14 > 1 5,ie p or ^pis c } 10 ; ce j e ^ us briefly 
recall the main results that are here obtained inverting the Laplace transforms (11) 
taking into account that now 

B(s ) = , ( 23 ) 

hence 

[^ u o(t) = E 01 (-A i*) = Ep u i (-A fft) , 

\us(s) = J t E A (~ XtPl ) = , 

(24) 
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Here E tl (z) and E li>v (z) (with fi > 0, v > 0 and zeC) denote the Mittag-Leffler 
function, in one and two parameters respectively, on which the reader may inform 
himself by consulting e.g. the books 17,18,19 an( j ^c articles 20,2 '. Now let us recall 
the general results relevant for us, that is, the Laplace transform pair, see Eq. (1.80) 


(25) 

and j Ew (—Af M ) is CM function if 0 < fj, < 1 and v~> \i. This fact can be proved as a 
consequence of the property according to which, if 0 < n < 1 and v > /z, the function 
E^i-x) is CM for x > 0, see 22,23 , or of the Laplace transform pair (25), see 24 . 
The asymptotic behaviours of the basic solutions can be obtained without detouring 
on their explicit expression in terms of the Mittag-Leffler functions but invoking the 
Tauberian theory. Restricting our attention to the fundamental solution, we obtain 



u 0 (t) 


{ 1 r* 
Ar(i-A)’ 

1_ 

r(i + A)’ 


t 

t 


+ 00 , 

0+. 


(27) 


3.2. The double-order fractional relaxation 

We now consider the choice 

b(0) = M(/3 - 0i) + M(/3 - fc ), with O<0 1 <0 2 <1, (28) 

where the constants bi and b 2 are both positive, possibly restricted to the normal¬ 
ization condition b\ + b 2 = 1. In this case we have 

B{s) = b lS ^ + b 2 s 02 . (29) 

The Tauberian theory implies for the fundamental solution as follows, taking into 
account that s@ 2 is negligibly small in comparison to s 13 'for s —> 0 + and, viceversa, 
.s' 3 ’ is negligibly small in comparison to s^ 2 for s —» +oo, 



U(i(t) 


(h t~* 

J a r(i-A)’ 

i_ 

[ 6 2 r(i + /?i) 


t —» +oo, 
t —> 0+ . 


(31) 
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3.3. The uniformly distributed order fractional relaxation 

We now consider the choice 


For this case we have 


m = i. 


hence 


u 0 (s) = - 


s - 1 


1 


(32) 

(33) 

(34) 


sAlogs + s-1 s sAlogs + s- l' 

Then, invoking the Tauberian theory for slow varying functions b , a topic adequately 
treated in the treatise on Probability by Feller 13 , we have 

1 

—- , s —► u 1 , 

(35) 


Uo(s) r 


Xs\og(l/s) 


logs 


-> 0 + , 

■+ +oo, 


Uo(t) 


Is 


logt ’ 

Atlog(l/t), t-» 0+. 


(36) 


4. Conclusions 

We have studied in detail the distributed order fractional relaxation equation, the 
structure of its solutions, and in a few cases their asymptotic behaviour near zero 
and near infinity. The remarkable fact is that, in case of non-trivial distribution 
of fractional time derivatives, the smallest order determines the behaviour near 
infinity, but the largest order governs the behaviour near zero. The investigated 
equation can be considered as a transparent model for more general time fractional 
evolution equations in a Hilbert or Banach space where our relaxation coefficient 
A is replaced by an operator A, positive in appropriate sense and acting in such 
space. As a relevant example we cite the equation of distributed order fractional 
diffusion, where in the linear case the individual Fourier modes exhibit fractional 
relaxation. We are planning to extend our investigation to the study of the concrete 
interpretation of general subordination formulas, see e.g. 25,26 , in terms of integral 
transforms and special functions, in particular those of Mittag-Leffler type. For the 
related problem of fractional diffusion of distributed order we refer the reader to 
some recent papers including 27,28,23,30 . 


b Definition: We call a (measurable) positive function a(y), defined in a right neighbourhood 
of zero, slowly varying at zero if a(cy)/a(y) —> 1 with y —* 0 for every c > 0. We call a 
(measurable) positive function 6(y), defined in a neighbourhood of infinity, slowly varying at 
infinity if b(cy)/a(y) —> 1 with y —► oo for every c > 0. Examples: (logy) 7 with 7 € R and 
exp (logy/log logy). 
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We describe a form of modulation, namely a dishomogeneous Poisson process whose 
event rate changes sporadically and randomly in time with a chosen prescription, so as 
to share many statistical properties with a corresponding non-Poisson renewal process. 
Using our prescription the correlation function and the waiting time distribution between 
events are the same. If we study a continuous-time random walk, where the walker has 
only two possible velocities, randomly established at the times of the events, we show 
that the two processes also share the same second moment. However, the modulated 
diffusion process undergoes a dynamical transition between superstatistics and a Levy 
walk process, sharing the scaling properties of the renewal process only asymptotically. 
The aging experiment - based on the evaluation of the waiting time for the next event, 
given a certain time distance between another previous event and the beginning of the 
observation - seems to be the key experiment to discriminate between the two processes. 


1. Time series with inverse-power-law waiting times 

In this paper we numerically and theoretically discuss the statistical properties of 
a time series {t*} generated from within two different approaches to complexity, 
renewal and modulation, in such a way as to produce in both ways the same time 
distribution density iP(t) asymptotically decaying with an inverse power law. In 
our numerical treatment we use the simplest form: 

= (1) 

with 2 < fj, < 3. This distribution is properly normalized, and the parameter T, 
making this normalization possible, gives information on the lapse of time necessary 
to reach the time asymptotic condition when becomes identical to an inverse 
power law. 


‘also at IPFC-CNR via Moruzzi 1 56124 Pisa, Italy, and CNS-UNT, P.O.Box 311427 Denton, TX 
76203-1427, U.S.A. 
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We use the sequence {r,} to distribute events on the time axis. The first event 
occurs at t = tj, the second at time t = t\ + r 2 , and so on. The time intervals 
between two consecutive events are called laminar regions, the reason being that 
the dynamical model here under study to illustrate renewal theory is an idealization 
of the celebrated Manneville map 1 , with the time interval between two events 
representing the fluid regular state. We keep calling these time intervals laminar 
regions even when working with modulation. 

For the theoretical discussion of this paper, it is useful to turn the sequence of 
times {t*} into a diffusion generating fluctuation £(f). Each time laminar region 
is assigned through a coin tossing procedure either the value W or the value —W 
(W > 0), thus creating a dichotomous fluctuation £(t), which is interpreted as a 
stochastic velocity. We then shall study the time evolution of the coordinate x(t), 
obeying the dynamic prescription 

* = (■ (2) 

The central issue of this study of the two kind of diffusion processes (renewal or 
modulation) has to do with scaling, namely, the property: 

= (3) 

which is expected to hold true in the time asymptotic limit. Complexity, namely 
the departure from ordinary statistical mechanics, is signaled by either 8 ^ 0.5 or 
F(y) departing from the Gaussian form, or by both properties. 


2. Modulation vs. renewal 

The modulation approach to complexity, meant as the foundation of non¬ 
exponential waiting time distributions, is based on conventional Poisson processes 
whose rates sporadically changes in time (dishomogenous processes). For instance, 
a double-well potential under the influence of white noise yields the exponential 
distribution of the time of sojourn in the two wells 2 . In the case of a symmetric 
double-well potential we have 

m = Aexp(-At). (4) 

The parameter A is determined by the Arrhenius formula A = k exp[— Q/ksO] . In the 
case when either the barrier intensity Q 2 or temperature 6 3 are slowly modulated, 
the resulting waiting time distribution becomes a superposition of infinitely many 
exponentials. It is known 4 that a superposition of. infinitely many exponentially 
decaying functions can generate an inverse power law. If values of r t , with different 
labels i are selected from different exponential distribution, the resulting process is 
no doubt renewal. To make it become a form of modulation theory, we have to draw 
a large sequence of time values, with the index i moving from i\ to i i\ + Nj, 
with Nd » 1, from the same exponential distribution -0(r) = Aexp(—Ar). 
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In recent times, the term superstatistics has been coined 5 to denote an approach 
to non-canonical distributions, of any form, not only the Nutting (Tsallis) form, as 
in the original work of Beck 6 . We note that Cohen points out explicitly 5 that the 
time scale to change from a canonical distribution to another must be much larger 
than the time scale of each canonical process. Thus, we can qualify superstatistics 
as a form of modulation. According to the modulation theory, we write the waiting 
time distribution ip(t) under the following form 

= J dAII(A)Aexp(—At), (5) 

where 11(A) is the T distribution of order p — 1 given by 

n(A) = Yfr-i ) Xll ~ 2 exp (_AT) - (6) 

This formula was proposed by Beck 6 and used in a later work 7 . 

After generating the sequence {A_, } according to (6), we create the sequence {r,} 
with the following protocol. For any number Awe generate a sequence (t,-^)} 
with a distribution density ip(r) = A J exp(-A J r). To realize modulation, we create 
the sequence {t*} = {r 1 <Al) ,r^ Al) ,...T^ l) ,r} Ai,) ,r^ All) ,...r^ | !,) ,...}. This means that 
after any extraction of A we draw a fixed number Nj of waiting times. Notice 
that according to the arguments of Cohen 5 for modulation to be identified with 
superstatistics, it is necessary to make Nj very large, virtually infinite. This serves 
the purpose of allowing the system to reach the local form of canonical equilibrium. 
In the case of this paper the condition of canonical equilibrium is replaced by a form 
of ordinary diffusion with ordinary scaling. This is the diffusion process generated 
by Eq. (2). 

Our prescription yields for tp{r) the non-exponential form of Eq. (1). We com¬ 
pare the generated modulation process with the corresponding renewal one, namely 
with the same iP{t). This latter process can be numerically obtained by setting 
Nd = 1, or, simply, by reshuffling the series {rj}. Notice that the renewal process 
can also be obtained by directly generating V»(r), without any recourse to Poisson 
distributions. In other words, the renewal process yields a time series which is ho¬ 
mogeneous and non-Poissonian. Since p > 2, the renewal process is ergodic, and 
the correlation function of the fluctuation f(i), (£(ti)£(t2)), with £2 > h, can be 
evaluated by adopting the time average, 

Using renewal theory 8 we find for the normalized correlation function $5 (t) 

*&) = ^mw+r)), ( 8 ) 

the following analytical expression 

$ «( r ) = ^r) j r dT< t ~ =* 


(9) 
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On the other hand the distribution density 11(A) is an equilibrium distribution 
allowing us to evaluate the correlation function through the prescription of Eq. (7) 
even if we realize the inverse power law distribution of Eq. (1) through modulation 
rather than by means of the renewal prescription. We note that the time spent 
by the system with a given A is inversely proportional to A. Thus, the use of the 
prescription of Eq. (7) yields for the stationary correlation function, the expressions 


= 


JdX^ex p(-At) 
fd A^ 


(10) 


By integrating Eq. (2), squaring x(t), averaging on the Gibbs ensemble, and exploit¬ 
ing the stationary nature of the correlation function (£(ti)£(t2)) = (?(0)£(^2 — ti)), 
we obtain that (x 2 (t)> = 2 W 2 J* dt' /*' dt"$ e (t"). 

We conclude that the condition 2 < p < 3 makes our prescription to modulation 
to generate the same superdiffusion of the corresponding renewal process. As a 
consequence, studying the second moment of the diffusing variable x, through the 
average over the distribution p(x, t) of the diffusing process is not sufficient to 
discriminate between renewal and modulation. 


3. Continuous-Time-Random-Walk approach to diffusion 

We now address the problem of diffusion generated by modulation and use the 
continuous-time random walk to derive the asymptotic scaling properties of the 
process. The problem of diffusion with renewal has been the object of earlier work 
9 to which we refer the interested reader to appreciate the difference between renewal 
and modulation on this specific issue. Here we limit ourselves to noticing that the 
Levy scaling , namely 8 = l/(p —1) and F of Eq. (3) being asymmetric Levy (p— 1)- 
stable function, is a property of the central part of the spreading distribution, which 
is limited by ballistic peaks forcing the diffusion process to yield multi-scaling. 

We now prove how scaling is driven by the crucial events, defined as the change 
of A in our modulation prescription. In fact, each new drawing from n(A) of a value 
A sets the rule that Nd times r, have to be drawn from the same exponential waiting 
time distribution, V’a(t) = Aexp(—Ar). This generates a subsequence that for large 
Nd is very extended, thereby producing a diffusion process with diffusion coefficient 
D\ inversely proportional to A. This stochastic diffusion rule lasts for a time that 
is equal to the sum of the Nd times. The concept of event implies unpredictability, 
a property shared by the random drawing of a given A, and by the successive Nd 
random drawings of the times T{ s from the distribution of ^\{t) as well. However, 
according to our definition only the drawing of A is crucial. 

We define as P(x, t) the probability density of moving by a quantity x, either 
positive or negative, during time t, as an effect of the Nd drawings from the same 
Poisson distribution. Analogously, with the symbol pf") (x, t) we denote the prob¬ 
ability density that the particle moves by the quantity x, as a result of n crucial 
events, occurring in such a way as to ensure that the particle moves by the quantity 
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x exactly in a time t. Note that after the occurrence of these n crucial events, 
the particle is in general located at a distance x' from the origin different from x. 
With n + 1 events the particle might overshoot that position. Thus the particle 
might make the remaining trip using the value of A drawn at the last crucial event, 
occurred at a time t' < t. In other words, we calculate p(x,t), i.e., the probability 
density of finding the particle in position x at time t using the formula 

p(x,t) = jtj™ dt' j + °° p( n \x',t')N{x-x', t-t') + N(x,t). (11) 

Here the quantity N(x,t) denotes the probability density of moving by a quantity 
a: in a time t with no crucial event occurring. The Fourier-Laplace transform of 
p(x,t), p(k,u), is given by the expression 

p(fc,u)= }- -N(k,u). (12) 

1 - P(k,u) 

This expression is of crucial importance to determine the resulting scaling. To 
reach this important result we have to define first the function r/; M (x,t). This is 
the probability density of moving by the quantity x in time t, with i time drawings 
from the same Poisson distribution. This important function reads 

*l> {i) {x,t) = f dX^\x,t)U{X), (13) 

J o 

where (x, t) denotes the probability density of moving by x in time t as a result 
of drawing i numbers from the Poisson distribution corresponding to the same value 
of the parameter A. The functions ip^\x,t) obey the following recursion relation: 

*$\x,t) = J dt' J dx ! fpx ~ 1 \x:,t')ip^\x-x',t-l/), (14) 

with 

^ ] (x, t) = Aexp(-At)i [«(* - Wt) + S(x + Wt)}. (15) 

In conclusion, the physical meaning of the function ^ l \x, t) of (13) corresponds to 
adopting the following procedure. With probability density 11(A) we draw a given 
A. Then, we draw i values of time intervals, and we move the particle by a quantity 
x with these i drawings. 

With these prescriptions we express the quantity P(x,t) = P (1> (x, t) as follows 
P w (x,t) = ^(x,t). (16) 

In other words, the transition by the quantity x in time t generated by a single 
crucial event is derived from Eq. (14) with i = N,i. Finally, for N(x, t) we have 

N{x,t) = / + °° 

Jo 


d\n(X)N\(x, t), 


(17) 



(18) 


N\(x, t) = 


X<i r t ,+o 

U«L 


dx'ij) 


1 ) (ar',i')'®f A {x-x',t-t'), 


where with ip^\x,t) we denote the initial condition 6(x)5(t). In (18) there are no 
crucial events involved because the maximum numbers of time drawings is JVj — 1, 
not enough to generate a new crucial event, if we start at time t = 0 with a crucial 
event. As a result of this partial number of drawings the particle reaches position 
x' in time t'. The remainder portion of space x — x' in the remainder portion of 
time t — t' is traveled with no further time drawing, according to the prescription 


\MM) = 


[S(x + Wt) + 8(x-Wt)} 


dt'e 


(19) 


To establish the scaling produced by the modulation approach, we have to eval¬ 
uate the Fourier-Laplace transform of ip^(x,t), ^\(x,t) and P(x,t). Using the 
convolution theorem we have: 




» r 

+ k 2 W 2 \ 


’J'a (k,u) = - 


(t* + A) 


' (u + A ) 2 + k 2 W 2 
From Eqs. (20) and (16) we derive immediately 

P(k,u) = f+°°d\n(\) [ - A ^ + A ^ 


(u + A) 2 + k 2 W 2 \ 

The evaluation of the asymptotic properties, u —► 0 and k - 


(22) 


s essential 

to assess the system scaling. If we make the assumption of sending u and k to 0 
first, and then integrating over A, we get p{k,u) « [u + A; 2 VF 2 (A -1 )a] -1 (implying 
6 = 0.5), where (•) denotes an average over an ensemble of Poisson processes, each 
of them characterized by a fixed value of A, selected from the distribution 11(A)/A 
and then kept fixed forever. We note, however, that p < 3 => (A -1 )a = +oo, 
casting some doubts on the conclusion that 5 = 0.5 (superstatistics limit 6 ). 

We now prove that the scaling stemming from a single modulated trajectory 
is the same Levy scaling that is found in renewal processes. In these processes 
p(k, u), according to the Levy theory 10 , is asymptotically p(k, u) « 1 - au - b ■ k a , 
where a and b are contant numbers. Using (22) we get this asymptotic property 
provided that we show that P(k, 0) »1 — const ■ k a . Note that we have to prove 
that a = p - 1. For this purpose we focus on Eq. (22), we set u = 0, and, for 
simplicity but without loss of generality, T = 1. Substituting y = X/k we obtain: 




dy. 


(23) 



(24) 


At this point, we use the binomial expansion and the useful property: 

( v 2 \ Nd = y 2Nd = i _ Eg ," 1 ( N *)y 21 
\y 2 + 1 ) E t =o ( N t d )y 2 ' E^o ' 

Let us plug this expression into the integral, and divide it in two parts: 

,-r kVdy _ rT j &L Qv* 

Jo E£o(t)3/ 2i 


^ if 


-y^e- Tk y d y\. 


The first term gives T(/i — and therefore the unity term in the zero-th 

order of P(k, 0). Looking at the second term, note that the integrand does not 
diverge in zero, at the infinity either: the integral can be considered as a Laplace 
transform (in Tk) of a finite quantity. So, at this first order, we obtain a constant. 

In conclusion, for the integral (23) we obtain the expression 1 — const ■ 
which is the same first order expansion as for the renewal process, thus yielding S = 
1 / (y — 1), a property expected to show up asymptotically, whereas the superstatistics 
scaling S = 0.5 corresponds to short time scales, where the scenario of a statistical 
ensemble of never-changing Poisson processes is very accurate. 


4. Aging effects in renewal and modulation theories 

We have dealt with a number of similarities between two approaches to inverse- 
power-law relaxation: a dishomogeneous Poisson process and a homogenous renewal 
one. This distinction is widely made when studying glass-forming liquids. Also the 
related phenomenon of aging has been known for a long time as a property of spin 
glasses and polymers 11 . The most popular manifestation of aging is given by two 
time correlation functions, depending on two times ti and t? > t\ not only through 
their difference. The decay as a function of ti — t\ becomes slower for larger t\. 
Aging is thought to be determined by the fact that the system under study is out 
of equilibrium and that the regression to equilibrium is involves times larger than 
the observation time 12 . 

Here we have in mind renewal aging. For recent papers on this form of aging 
we refer the readers to the following few papers 13,14,15 . j^g renewal model stud¬ 
ied herein yields renewal aging, whose immediate manifestation is revealed by the 
dependence of ip(t) on the observation time. 

The quantity ip(t)dt is the probability that a laminar region beginning at t = 0 
ends in the small interval [t,t + dt\. If we have at our disposal a Gibbs ensemble of 
sequences, all of which begin with the beginning of the first laminar region, located 
at t = 0, to derive experimentally ip{t) we have to observe the time at which the first 
laminar region of each sequence of the sample ends. This is equivalent to making 
preparation and observation at the same time. Let us imagine now that preparation 
is made at time t = —t, n < 0. The first measured waiting time is denoted by T\. 
The first waiting time, at variance with the observation of the successive waiting 
times, does not necessarily correspond to the total time duration of a laminar region. 
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The resulting histogram records time lengths that are generally smaller than those 
corresponding to preparing the system at time t = 0. Nevertheless, in the case when 
the waiting time distribution is exponential, both long and short time lengths are 
reduced by the same percent. Thus, turning the histogram into a normalized waiting 
distribution density has the effect of recovering the same exponential form. A 
renewal exponential process does not age. In the non-exponential case delaying the 
observation process has the effect producing a percent cut of the short-time laminar 
regions larger than that of the long-time laminar regions. As a consequence, with 
the normalization of the distribution, the weight of the short-time laminar regions 
is reduced and the weight of the long-time laminar regions is enhanced, thereby 
generating a slower decay of the survival probability \t(t). 

We numerically generated the 11(A) distribution and used this approach to gen¬ 
erate trajectories, i.e., artificial sequences of random waiting times. We compared 
the results for the aging analysis of trajectories characterized by the same exponent 
(i of the power-law, but generated from the renewal process and from modulation 
processes with different Nd- 

Given the sequence of waiting times and an aging time t a , we compute the 
truncated waiting times, i.e., the difference between each waiting time and t a ■ When 
the waiting time is shorter than t a , then we take the successive waiting times until 
their sum exceeds t Q . Then the truncated waiting time is defined as the difference 
between this sum and t a . In this way, we obtain a sequence of truncated waiting 
times characterized by some aged probability density distribution 4>t a {j). Aging is 
revealed if this distribution changes with t tt . As stated, the modulation process with 
Nd = 1 is expected to coincide with the prediction of renewal theory. In Figs. 1 and 
2 we compare the renewal and the modulation process with different values of Nd- 
Rather than measuring the function ip ta , we evaluate the aged survival probability 
'bta , which is related to ip ta by the relation: 

*t.(T) = j°° AAr'W = 1 - j\ ta (T')dT'. (26) 

The left portion of Fig. 1 refers to the case Nd = 1. In this case, the choice of 
a given A determines only one waiting time. As a consequence, any laminar region 
does not have anything in common with the earlier laminar regions, and modulation 
is indistinguishable from renewal. The right part of Fig. 1 shows that it is enough 
to set Nd = 10 to make the dotted lines significantly depart from the dashed lines. 
We see that the dotted lines indicate a faster decay than the dashed lines, which 
implies that with modulation the aging effect is already significantly reduced. With 
a further increase of Nd (see Figs. 2 ) this effect becomes more pronounced. We see, 
in fact, that the dotted lines tend to overlap with the brand new survival probability. 
We conclude that for Nd —► oo the aging effect is annihilated. We thus conclude 
that superstatistics, as a form of infinitely slow modulation, yields no aging. 
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Figure 1. Left: Comparison between the function \Ft a of a renewal process (continuous lines) and 
the of a modulation process with N d = 1 (dots) at different values of t a = 0,50,100,150,200 
(from the lower to the upper curves). Right: Comparison between the function 'ita of a renewal 
process (dashed lines) and the function <S/ ta of a modulation process with N d = 10 (dots), at 
different values of t a = 50,100,150,200 (from the lower to the upper curves). The lowest curve 
represents the brand new function 'P(t). 



Figure 2. Left; The same as Fig. 1 (right), but with N d = 100. Right: The same as Fig. 1, but 
with N d = 500. 


5. Concluding remarks 

Let us discuss which are the main results emerging from this paper. First of all, we 
found that the waiting time distribution is not, by itself, an unambiguous indicator 
of complexity. This confirms the conclusion of earlier work 16 from within a new 
perspective made attractive by the modulation, or superstatistics, approach to com¬ 
plexity 5 ’ 6 . We have seen that the adoption of the aging experiment bypasses the 
limits of the conventional methods of analysis, since it establishes beyond any doubt 
the difference between the renewal and the modulation character of a sequence of 
times. This is a fact of some physical importance for the physics of blinking quan¬ 
tum dots 17 . The work of Brockmann et al. 18 has already established aging in the 
intermittent fluorescence of these new materials, and the more recent work of Ref. 
19 confirms that this aging is due to the renewal character of the process. Thus, 
we conclude, in agreement with Ref. 19 , that the dynamic process responsible for 
intermittent fluorescence must be built up on the basis of a renewal perspective. 
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Of course, the fact that superstatistics is ruled out as a proper perspective for the 
physics of blinking quantum dots does not mean, in any way, that there are no 
interesting complex processes in nature that might lay their roots on this attractive 
perspective. This remark is related to the second important result of this paper. 
Modulation, behind superstatitics, corresponds to a slow physical process whose 
realization does not rest on a unique procedure. However, it is a plausible that 
any realization of modulation might generate its own crucial events. These crucial 
events are embedded in a Poisson sea, exerting a camouflage action, which makes 
it extremely difficult, to reveal their existence. We have seen that these invisible 
events establish the anomalous scaling of the process. On the basis of the earlier 
work of Ref. 9 we think that this anomalous scaling refers to the central part of 
the probability density distribution, and that the resulting anomalous diffusion is 
multiscaling. There are good reasons to believe that with suitable developments 
along the lines of the work of Refs. 20,9 , it will be possible to address successfully 
this challenging problem. This is left as a subject of future work. 
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MARKOV MEMORY IN MULTIFRACTAL NATURAL PROCESSES 
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Records of physical phenomena, such as turbulence, have been successfully modeled by 
random multiplicative processes. The present work expands such treatments by consider¬ 
ing the effects of memory within the random multiplicative process and its consequences 
on the multifractal behavior of the measure. The measure-generating multiplicative 
cascade treated here involves first-order, two-state, Markov multipliers. When the two 
self-transition Markov probabilities, pa, i — 1,2, are equal, yet different from 0.5, the 
average occurrence of the multipliers converges to 50% as in the memoryless case. Nev¬ 
ertheless, the Markov memory influences the spread of multipliers. The conservation of 
measure now relaxes to convergence towards a nontrivial and finite value and the shape 
of singularity spectrum depends to a great extent on the Markov probabilities. Appli¬ 
cation of the model to turbulence data indicates an underlying anti-persistent Markov 
process. 


Keywords: multifractal, cascade, Markov, turbulence, persistence 

1. Introduction 

Complex physical processes, such as turbulence are known to be multifractal in 
nature [1-5]. Typical models of such processes are measures generated by multi¬ 
plicative cascades, describing the constant redistribution of a measure from coarser 
to finer scales. The earliest and simplest multiplicative cascades involved inde¬ 
pendent fixed or random multipliers [6] on a tree-based structure and were not 
adequate to represent the underlying physical process, in contrast to more recent 
models which bring in an infinite number of random multipliers [7] and continu¬ 
ous scale invariance [8]. As it has been recognized that natural phenomena often 
exhibit short or long-range memory [9,10], there is good reason to assume that the 
redistribution of measure across different scales during the cascade should not take 
place through independent steps. However only recently the study of dependent 
cascades has come to focus in strictly mathematical sense [11] and on finite-state 
Markov generators [12] and turbulence [13-15]. 
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Markov sources are good models of a variety of physical processes, from the 
most familiar example of statistical mechanics, the Ising model, to the dynamics of 
Galton board processes [16-17]. Indeed the dynamics of the Galton board systems 
cover a wide spectrum of physical processes as for instance electronic solid-state 
diffusion [18], turbulent flow dynamics [19,20], optical interference [21], to name just 
a few. The analysis of multiplicative processes, where each multiplier is not just the 
random outcome of a probabilistic process, but of a Markovian memory-possessing 
source, can therefore find wide applications while providing useful insights to the 
underlying mechanisms of physical processes. 

In this paper we combine the multifractal character of binomial multiplicative 
measures with the memory present in a first-order Markov process; the latter deter¬ 
mines the transition probabilities in the generation of the two-state Markov multi¬ 
pliers. In particular, we investigate cases of persistence and anti-persistence [22] in 
the evolution of the Markov multipliers and the consequences on the multifractal 
characteristics of the binomial measure. In section 2 we review the construction 
of multifractal measures by multiplicative cascades and the resulting multifractal 
formalism. In section 3, the mathematical formalism of the two-state, first-order 
Markov process is reviewed for cases of persistence and anti-persistence. In section 
4, we study the multifractal properties of multiplicative cascades driven by Markov 
processes considered in the previous section. Finally conclusions and applications 
are discussed in section 5. 

2. Review of multifractal cascades 

The original and most simple of multiplicative cascades, the binomial cascade, has 
been introduced as a model for the energy dissipation in fully developed turbu¬ 
lence [5]. To construct the binomial cascade one can start with an initial mass Mq 
uniformly distributed over the interval [0,1] and two constants mi and m2, the 
multipliers. At the first step of construction, the interval is divided into two sub¬ 
intervals, [0,1/2] and (1/2,1], and the initial mass Mo is thus redistributed. The 
first sub-interval takes the mass M0TO1 and the second M^m2- In the second step, 
each sub-interval is divided also into two new sub-intervals of equal length and its 
mass is also redistributed as was done in the first step. The cascade continues to 
the k th step where the initial mass is redistributed over a set of dyadic intervals of 
length 2~ fc , the support of the measure. The mass contained in each sub-interval is 
thus predetermined by the current sequence of multipliers. In order for the measure 
to be conserved at each step, the multipliers must satisfy the simple relation 

m\ + m 2 = 1. (1) 

This type of multifractal measures, where the constructed cascade exactly prescribes 
the sequence of the multipliers for each sub-interval is thus a restricted one. The 
restriction can be alleviated and the multipliers randomized if they are allowed to 
occur at fixed probabilities, for example p and 1 - p, respectively [23]. In this case 
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the exact conservation of the measure is relaxed to apply to the conservation of the 
measure on the average. 

pmi + (1 - p)m 2 = 1/2. (2) 

The total measure M plays now the role of a random variable (r.v.), fl, with 
expected average, E{Sl} = 1. In other words, in the limit where the number of 
construction steps tends to infinity, k —> oo, the measure M is equal to the initial 
mass only on the average and for a large number of cascading sequences, k. Such 
cascades are called conservative or micro-canonical, in analogy to thermodynamics 
and we will refer to them as independent conservative cascades in contrast to the 
dependent Markov cases presented in section 4. As a further generalization to 
the case of fixed multipliers we consider two independent realizations of a random 
variable m [2]. The conservation of the measure on the average is satisfied in 
canonical multifractals for which 


E{m} = 1/2. (3) 

In order to study the multifractal behavior of such measures, the q th moments 
E{[Pk] q } °f the measure pk contained in dyadic intervals of length 2 -fc are required. 
The measure pk equals the measure p^ redistributed by the cascade to a random 
interval at the k th construction step multiplied by the r.v. fl a ; p k = p^fl. Thus 
the q th moments can be written as 

E{[p k ]«} = E{[pWm- (4) 

Note that only in the case of restricted, or conservative, multifractals the r.v. fl is 
always independent of p( k K Then a partition function r(q) is defined through the 
relation 

(6) 

And if the q th moments of Q. are positive, finite and independent of p^ for every 
q, then at the limit k —► oo, ft can be omitted and equation (5) can be written as 

(<) 

By appealing to the multifractal formalism found in [23-26] the scaling (Holder) 
exponents, h(q), are given by the derivative 


h(q) 


rfr(g) _ log 2 e dE{[p < - k '>]i} 


kE{[p( k )}«} dq 
The spectrum function f(q) is defined by the Legendre transform of r(q) [2 
log 2 e dE{[pW]«} t logafflfrW]*}] 


/(«) = qh{q) ~ r{q) = -q 


kE{[p( k m dq 


+ 1. 


(7) 

(8) 


a Each dyadic interval at step fc can be considered 
initial mass pW. 


realization of the whole construction with 
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This review has considered for simplicity the dyadic grid, i.e. each interval is 
divided each time in 2 subintervals. Similarly, a generalization is possible for the 
case of an arbitrary b-adic grid, with an integer b as its base, i.e. each interval is 
divided each time in b subintervals. 


3. The first-order, two-state Markov chain 

The outcomes of random binary processes have a natural tendency to cluster just 
by chance [27]. In a Markov processes, however, this natural clustering can be 
further intensified or even weakened, depending on the type of memory present 
which connects the neighboring states in the evolution of the binary process. The 
transition probabilities in a two-state, first-order Markov process are shown in figure 



Pl2=1 “V 


Figure 1. State transition diagram of a first-order, two-state Markov process as a model of gen¬ 
eration of cascade multipliers. 


Once the outcome of a measurement finds the system to be at state A there is a 
probability p for the next outcome to also bring it to state A and 1 - p probability 
to bring it to state B. Once the outcome of a measurement finds the system to be 
at state B there is a probability v for the next outcome to also yield state B and 
1 - v probability to yield state A. If the absolute initial probabilities to find the 
system at either state A and B are p^ and p^\ respectively, where p^ = p 1; then 
after n measurements, the probability to find the system at state A is [17] 

Pn = a" 1 [pi - it] + u, (9) 

where u = 2 - \ p + l ,) , a = p + v — 1. The average expected occurrence of state A in 
the chain after n steps, p n , would be written as 


E{p n } =u + - 


- p=v 0.5 + 


Pi - 0.5 1 - (2p - l) n 


(10) 


where 0 < p < 1 and 0 < v < 1. From (9), (10) we conclude that the average 
expected occurrence of state A in the Markov chain converges to u which is 50% if 
p = v > 0.5 or equal to 50% for any number of steps, n, if the initial probability 
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to find the system at either states pi is 50%. The standard deviation of the mean 
value E [p n } is 



If p = v = 0.5 the Markov process is reduced to the Bernoulli, memoryless 
case. The presence of memory in the generation of states will make the scatter plot, 
n = f{E{p„ }), either to be broadened (p > 0.5, a case of persistence) or narrowed 
(p < 0.5, a case of anti-persistence) with respect to the random binomial sampling 
variation. We can now introduce the Markov source into the multiplicative cascades. 


4. Introducing memory in the evolution of the multiplicative 
cascade 

We consider again the process of the construction of the binomial measure as de¬ 
scribed above with positive multipliers mi and m 2 . At each construction step the 
multipliers appear with probabilities described by a first-order Markov process and 
thus the probability of each multiplier depends on the preceding multiplier at the 
previous construction step. Following the notation introduced in section 1, we de¬ 
note by pn the probability that if at the present step of cascade the multiplier is 
m i, in the next step the multiplier will also be mi. Also we denote by p 2 i the prob¬ 
ability that if at the present step of cascade the multiplier is mi, in the next step 
the multiplier will be m 2 , and so on. To exclude trivial cases, we will assume that 
none of the multipliers equals zero and that all probabilities are positive and smaller 
than one. After a large number of construction steps, mi, m 2 appear in the cascade 
with probabilities 2 -p- v an d with 2-p~u ’ respectively, equation (9). In the most 
interesting case where p = u, both probabilities equal 50%, but the cascade does 
not reduce to an independent conservative case, since the effect of memory could 
either introduce clustering of Markov multipliers, for p > 0.5, or their dispersion 
for p < 0.5. This naturally modifies the multifractal properties of the measure. 

Our first concern is to examine the conditions under which the measure converges 
to a finite value. It is shown that the measure is conserved on the average at each 
step only if p + v = 1 or if at least one of the multipliers is zero. These cases are 
of no interest in the present work since the effect of memory is canceled. However 
the measure converges almost surely to a finite value b other than zero in the limit 
fc —> oo, when the following relation holds 

4(1 — p — i/)mim 2 + 2(pmi + vm 2 ) = 1. (12) 

In the trivial case, where p+v = 1, relation (12) reduces to (2). In figure 2, examples 
of allowed pairs of multipliers are presented, both for the symmetrical case, (A), 
where p = v and the asymmetrical case (B), where p / v. Note that the diagrams 


b Note that this value is not necessary equal to the initial mass. 
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Figure 2. Examples of allowed pairs of multipliers for various values of Markov self-transition 
memories. (A) Symmetric case, p = v. (B) Asymmetric case, p ^ v . 


are symmetric with respect to the bisector and that all lines intersect at the point 
(1/2,1/2), which corresponds to the trivial case where both multipliers are equal to 
1/2. Furthermore the multipliers cannot be both smaller than 1/2 or greater than 
one, since in such cases the total measure would either be zero or infinity as k —► oo. 
In the memoryless case, figure 2, the multipliers lie upon a straight line, instead. 

Since the total measure Cl is also a random variable, its limiting probability 
distribution function would be required in order to fully describe the construction. 
However, if both multipliers are smaller than 1, then the moments E{Cl q } are finite 
for every q [28]. We shall restrict our analysis to this case, while the more general 
case is reserved for a future work. 

The next step is to study the q th moments of the measure assigned to a 
random dyadic interval at the k th construction stage of the cascade. By associating 
a binary r.v., which equals either — In 2 log 2[mi] or - In 2 log 2 [m2], to the states of 
the Markov process, it can be shown by linear algebra that 

£{[/]«} = 2- fc 



And since a Markov chain obeys a Large Deviation Principle [29], the multifractal 
formalism applies to our cascade. Furthermore the partition function is 


r{q) 


log 2 pm? + 



where the factor containing the variable Cl has been omitted since its moments are 
finite. From Eq. (12) we have the anticipated property r(l) = 0 as a result of the 
conservation of the measure. Another special value of r is — t(0) = 1, since —r(0) 
equals the fractal dimension of the support of the measure, which in our case is 1. 
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If m 2 < mi < 1, then in the limit q -*• oo, r(q) is given by 

r{q -* oo) = -1 -log 2 [p] -gl°g2[wii], (15) 

and in the limit q —> — oo by 

r(q -*■ -oo) = -1 - logaM - «log 2 [m 2 ], (16) 

which implies that r(q) is a linear function of q for very large positive and negative 
values of q. The Holder exponents are given by 

log 2[mi/m 2 ](pm'' - vm\) _ /off 2 mim 2 


Kg) = -- 


(17) 


2 \J (pm\ + vm\) 2 — 4(mim 2 ) 9 (p + v — 1) 2 

For q = 0 we obtain the most frequent scaling exponent 

_ log 2 [mi](y - 1) + log2[m 2 ](p - 1) 

2 -p -v ’ 

and in the case where p = v 

log 2 [mi ] + log 2 [m 2 ] 

2 

By Eqs. (7), (15) and (16), the minimum value of the Holder exponent h m i n and 
the maximum h max are 


h(q = 0) = - 
p=u 

h(q = 0 ) = -- 


(18) 

(19) 


hmin = - log 2 mi and h max = - log 2 m 2 (20) 

Thus since both multipliers are smaller than one and h is monotonous, h(q) > 0 for 
every q. The spectrum function f(q) is 

./ v _ _ Iog 2 [mi/m 2 ](pmf - vm\) _ log 2 mim 2 

+ vm\) 2 - 4(mim 2 )«(p + v - 1) 9 2 

+ log 2 J pml + vm\ + ^(pm\ + vm q 2 Y - 4(mim 2 )«(p + v - 1)| (21) 

And at the limits q —* ±oo 

f(q -»■ oo) = 1 + log 2 [p], (22) 

and 

f(q ~ > —oo) = 1 +log 2 [i/]. (23) 

Since the shape of f(h) is cap convex, we expect that negative dimensions will 
appear whenever at least one of the probabilities p, v is smaller than 1/2. On the 
other hand if p, v are greater than 1/2 then the minimum fractal dimension is 
positive. In figure 3 we present typical spectra for p = v and p/i/. It is obvious 
that the shape of the f(h) curve depends on the values of p and v. When p = u, 
f(h) is symmetric, while if p / i/, there is asymmetry between the right and left 
side. Furthermore, as the behavior of the cascade changes from anti-persistence to 
persistence, the spectrum becomes wider and more flat in order to obey equation 
(12). 



Figure 3. Multifractal spectra of Markov binomial cascades for p = v (A) and p ^ u (B). Solid 
circles: integer values of q . 


5. Discussion 

We have shown that by dropping the assumption of independence between the 
construction steps of a binomial conservative cascade, the multifractal properties 
of the resulting measure are significantly enriched. In particular, the shape of the 
multifractal spectrum depends only on the probabilities of the Markov chain and 
any asymmetry in the spectrum is a result of a non-symmetrical transition matrix. 
Persistence or anti-persistence in the underlying Markov process, leads to strictly 
positive values of the spectrum ( f(h ) > 0 for every q) or negative values (f(h) < 0 
for some q), respectively. In contrast to the independent binomial cascade, these 
features may arise on both sides of the spectra at the same time. However, the 
most important innovation of the Markov cascade is the fact that the condition 
for convergence of the measure allows the multipliers to take a much wider range 
of values than in the independent case. Furthermore, while in the latter case, 
the measure is conserved on the average at each step, in the dependent case the 
conservation is relaxed to convergence, i.e. the measure converges to a finite value, 
which is not necessarily the initial mass. 

Although these properties make the Markov cascade attractive for the model¬ 
ing of a wide variety of natural processes, we will restrict our discussion to the 
case of energy dissipation in turbulence 0 . While the energy is conserved in 3 di¬ 
mensions, this might not be the case across a one-dimensional cut. Additionally, 
the convergence of the measure ensures that the energy will not degenerate to zero 
or tend to infinity. As an example we will use the Markov cascade to model the 
results from an experiment performed in [30], where also negative values of f(h) 


c Due to present shortage of space, a more 
postponed for a future work. 


to experiments will 


in-depth study of relevance 
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Figure 4. Multifractal spectrum. Open circles: experimental turbulence data of ref. [30]. Solid 
line: Markov cascade generated with self-transition probabilities p = v = 0.308, and multipliers 
mi = 0.907 and m2 = 0.194. 


were estimated using an improved box-counting algorithm [31]. In figure 4, the 
best fit to the spectrum (estimated from experimental data) is presented yielding 
p = v = 0.308, mi = 0.907 and m 2 = 0.194 . The simulated and experimental 
spectra are in very good agreement and even though the latter is estimated only 
for — 2 < q < 5, we nevertheless calculated the complete spectrum of the Markov 
cascade for -00 < q < 00. Such expansion is justified by the shape of the super¬ 
imposed multiffactal spectra of the experiments performed in [30]. The turbulence 
spectrum is symmetric and indicates an anti-persistent Markov cascade, where the 
multipliers alternate very rapidly. This behavior leads to very rare extremely large 
and small fluctuations and consequently to negative values of f{h). For the esti¬ 
mated Markov parameters, the left part of relation (4.1) equals 0.95 which is very 
close to unity and consequently the measure will diverge slowly towards infinity 
as k —► 00. Furthermore, the spectrum of the Markov cascade is somewhat nar¬ 
rower for small values of q (around the maximum of /(h)), which implies the need 
for a more complex model. We expect that a more general cascade driven by a 
multi-state, continuous Markov chain will improve the fit to experimental data and 
remove the constraint of discrete scale invariance, but this task is reserved for a 
future work. 
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It is shown that complex systems can be described in terms of self-organization pro¬ 
cesses of prime integer relations. The prime integer relations are indivisible elements 
built from one level to the next by using the integers as the basic constituents. Prime 
integer relations specify nonlocal correlations between the parts of a complex system and 
can be represented as two-dimensional geometric patterns with fractal properties. Con¬ 
trolled by arithmetic the self-organization processes of prime integer relations describe 
complex systems by absolutely true information and do not require deeper principles 
for explanations. This gives the possibility to develop an irreducible theory of complex 
systems. 


1. Introduction 

Complex systems profoundly change human activities of the day. In order to un¬ 
derstand and control the developments, it is becoming increasingly important to 
have confidence in the theory of complex systems. Ultimately, this requires clear 
explanations why the foundations of the theory of complex systems are valid in the 
first place. The ideal situation would be to have an irreducible theory of complex 
systems not requiring a deeper explanatory base in principle. But the question 
arises: where such an irreducible theory might come from at the time when even 
the concept of space-time is questioned 1 as a fundamental entity? 

As an answer to the question, it is suggested that the concept of integers may 
take responsibility in the search for an irreducible theory of complex systems 2 . The 
aim of the paper is to present an irreducible description of complex systems in terms 
of self-organization processes of prime integer relations. A prime integer relation is 
an indivisible element in the sense that none of its components can be considered 
separately to result in a different prime integer relation. Controlled by arithmetic 
the self-organization processes characterize complex systems by absolutely true in¬ 
formation and do not require further explanations. This gives the possibility to 


'This work is supported by CQU Research Advancement Awards Scheme grant no. IN9022. 
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develop an irreducible theory of complex systems. 


2. Invariant Quantities of a Complex System and Correlations 

We approach complex systems from a general perspective. In particular, we consider 
the dynamics of a complex system in order to understand correlations between the 
parts. For this purpose we describe a complex system by its certain quantities and 
are interested to find out how many of them remain invariant as the system evolves 
from one state to another 2 , 3 . 



ure 1. For states * = +l-l + l- l- l + l + l + landa:' = -l-: 
have /i 1 !(ta) = s' l l(t 8 ), where / = p me s(x),g = PmesW) and m — 0, 




Let I be an integer alphabet and In = {x = Xi ...xn,Xi € I,i = 1 , ..., N} be the 
set of sequences of length N > 2. We consider a complex system of N elementary 
parts with the state of part Pi specified by a space variable Xi € I,i = 1,..., N and 
the state of the complex system itself by a sequence x = x\...xn € In- 



Figure 2. For the states x and x' we also have /I 2 )(t 8 ) =s( 2 l(t 8 ). It is clear that/l 3 l(t 8 ) / gW(t a ) 
and thus C(x, x') = 2. 
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We use piecewise constant functions for a geometric representation of the se¬ 
quences. Let £ > 0 and S > 0 be length scales of a two-dimensional lattice. Let 
PmeS ■ x —* f be a mapping that realizes the geometric representation of a se¬ 
quence x = xi-.Xn € In by associating it with a function / £ 
denoted as / = p me( $(x), such that f(t m ) = x\5, f(t) = z;<5, t € (t m +i_r, t m +i], i -- 

1.. .., N , tj = ie, i = m , ...,m + N and whose integrals /l fc l satisfy = 0, k = 

1.2.. .., where m is an integer. The sequence x = X\...xn is called a code of the 
function / and denoted by c(/). 

We use the geometric representation to characterize a state x = x\ ...xn € In of 
a complex system in terms of the definite integrals 

f [k] {t m+N ) = f\ k ~ l \t)dt, /1°1 = /, k = 1,2,... (1) 

of a function / = p me s{x) e W e s[tm,t m+ N] 2 • The definite integrals specify certain 
quantities of the complex system. 

The integer code series 4 expresses the quantities (1) of a complex system in 
terms of the state x = x\...xn € In explicitly. Namely, it describes the definite 
integral 


f lk] (tr 


l+ ;\r) = akmi({m + N)*xi + ... + (m + 1) 8 xjv)£*<1 


( 2 ) 


of a function / e W e s([t m , t m+ N}) by using the code c(/) = x\...xn of the function 
/, powers (m + TV)*,..., (m + l)‘ of integers (m + N ),..., (m + 1) and combinatorial 
coefficients 


akmi = ((—1 ) fc - i ~ 1 (m + l) fc - i + {~l) k ~ i m k ~ i )/(k - i)\i\, 
where k > 1 and i = 0,..., k — 1 4 . 

We are concerned how many quantities (1) remain invariant as a complex system 
moves from one state x = Xi...xn € In to another x' = x\...x' N € In 2 

f [k] {t m+N ) = 9 lk] {t m+N ), k = l,...,C(x,x'), (3) 

f\ c ( X , X ') + l) { t m+ N) J: fl [C(x,x')+l) (Wiv)i (4) 

where / = p m£ s{x),g = pmesix') (Figures 1 and 2). We consider the conservation 
of the quantities (3) as a consequence of correlations between the parts of the 
complex system. In particular, although the complex system moves from one state 
to another, the changes of the parts, nevertheless, are correlated to preserve the 
quantities. The more of the quantities are preserved the stronger the correlations 
between the changes of the parts. 
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3. The Conserving Correlations as Linear Equations 

As a complex system evolves from one state x = x\...xn e In to another x' = 
x[...x' N e In, it is proved 2 , by using (2), that the number of its C(x,x') > 1 
quantities remain invariant, iff the space-time changes Ax; = x\ — x,, i = 1, N of 
the elementary parts are correlated to satisfy C(x,x') linear equations 

{m + N) k Ax 1 + ... + {m + l) k Ax N = 0, (5) 

k = 0, C{x, x') — 1 and an inequality 

(m + N) c( ~ x - x ">Axi + ... + (m + l) c< - x ' x ) Axn 0. (6) 

Moreover, the number C{x,x') of the conserved quantities of a complex system 
satisfies the condition 0 < C(x,x') < N 2 . The coefficients of the linear equations 
(5) become the entries of the matrix 

(m + N)° (m + N- 1)° ... (m + l)° 

(m + JV) 1 (m + N — l) 1 ... (m + 1) 1 

(m + N) 1 *- 1 (m + N- l)^" 1 ... (m + l)^- 1 
with Vandermonde determinant, when the number of the equations is N. This fact 
is important in order to prove that C(s, s') < N. 



Figure 3. One of the hierarchical structures associated with the integer relations (7) and inequality 
(8). The structure may be interpreted as a result of a self-organization process of prime integer 
relations. It starts with integers 16,13,11,10,7,6,4,1 generated in the positive state and integers 
15,14,12,9,8,5,3,2 generated in the negative state on the zero level. The self-organization process 
makes the prime integer relations from the first level to the fourth guided by a single principle. 
Arithmetic forbids the process from reaching level 5, as the left side of (8) cannot be zero. 
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4. Self-Organization Processes of Prime Integer Relations and 
Correlation Structures of Complex Systems 

By using the dynamics Ax ,,i — of the elementary parts, the analysis of 

linear equations (5) and inequality (6) reveals hierarchical structures of prime in¬ 
teger relations in the description of a complex system. Through interpretation of 
such hierarchical structures we identify self-organization processes of prime inte¬ 
ger relations 2 , 3 . Starting with the integers as the elementary building blocks 
and controlled by arithmetic the self-organization processes make the prime integer 
relations of one level from the prime integer relations of the previous level. 



Figure 4. A correlation structure of the complex system is built in accordance with the hierarchi¬ 
cal structure of prime integer relations (Figure 3). The elementary parts Pie, ■■■,Pi are depicted as 
integers 16,..., 1 to show the correspondence between the composite parts of the complex system 
and the prime integer relations. The horizontal edge denotes that the parts of the complex system 
are correlated through a prime integer relation. 


We illustrate the results by considering two states of a complex system 
m = —1 + 1-bl — 1-1-1 — 1 — 1-+-1 + 1 — 1 — 1 + 1 — l + l-l-l — 1, 

s'= +l-1-1 + 1-l+l + l-l-l + l + l-l + l-l-l + l 
specified by the Prouhet-Thue-Morse (PTM) sequences of length N = 16. In this 
case the equations (5) become four integer relations k = 0,1,2,3 as C(x, x') = 4 
and m = 0 

+16° —15° —14° +13° —12° +11° +10° — 9° — 8° + 7°+6° —5°+4° — 3° — 2° +1° = 0, 
+16 1 -15 1 -14 1 +13 1 -12 1 + 11 1 + 10 1 —9 1 —8 1 +7 1 +6 1 -5 1 +4 1 -3 1 -2 1 +1 1 = 0, 
+16 2 —15 2 —14 2 +13 2 —12 2 + ll 2 +10 2 — 9 2 — 8 2 + 7 2 + 6 2 — 5 2 + 4 2 — 3 2 — 2 2 +1 2 = 0, 
+16 3 —15 3 —14 3 +13 3 —12 3 +11 3 +10 3 —9 3 —8 3 +7 3 +6 3 —5 3 +4 3 —3 3 —2 3 +l 3 = 0 (7) 
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and the inequality (6) takes the form 

+16 4 —15 4 —14 4 +13 4 -12 4 +ll 4 +10 4 -9 4 —8 4 +7 4 +6 4 -5 4 +4 4 —3 4 —2 4 +l 4 / 0, (8) 

where a common factor 2 originated from space-time variables A x it i = 1,16 is 
not shown for clarity. 



Figure 5. The integers and prime integer relation are pictured like "particles” to promote the 
integers and prime integer relations as objects of formation. Under the integration of the func¬ 
tion, the geometric patterns corresponding to integer 5 and integer 2 form the geometric pattern 
corresponding to prime integer relation +5° — 2° = 0. 


One of the hierarchical structures associated with the integer relations (7) and 
inequality (8) is shown in Figure 3. In the structure the relationships between 
the elements of neighboring levels may be interpreted as a consequence of a self¬ 
organization process of prime integer relations. The process starts with integers 
16,1 and proceeds level by level following the same organizing principle: 

on each level the powers of the integers in the prime integer relations are in¬ 
creased by 1, so that through emerging interdependencies the prime integer relations 
could self-organize to form prime integer relations of the next level. 

Remarkably, the formation of prime integer relations is more than their simple 
sum. Let us explain the notion of prime integer relation. A prime integer relation 
of the first level is the sum of integers from the zero level (Figure 3). Following the 
organizing principle a prime integer relation of one level is made from prime integer 
relations of the previous level. Notably, a prime integer relation is an indivisible 
element in the sense that it is not the sum of prime integer relations from the same 
level. For example, integer relation +7 2 - 6 2 - 5 2 + 3 2 + 2 2 - l 2 = 0 is a prime 
integer relation, because none of its components can separately produce a prime 
integer relation. At the same time integer relation +7° — 6° — 5° + 3° = 0 is not 
prime, because it consists of two prime integer relations +7° — 6° =0, —5° + 3° =0. 

The space-time dynamics Ax, of elementary part Pi, i = 1,..., N has the follow¬ 
ing interpretation. The absolute value of Ax, is the number of integers (m+N—i+ 1) 
involved in a self-organization process associated with the equations (5) and in¬ 
equality (6), while sign(Axi) determines the state, i.e., positive or negative, of the 
integers, provided that Ax* / 0, i = 1,..., N. 

The self-organization processes describe complex systems by hierarchical struc- 



tures of prime integer relations. The prime integer relations are absolute true state¬ 
ments and thus provide information that cannot be further reduced. In particular, 
there exist no deeper principles to explain why the hierarchical structures exist the 
way they do and not otherwise. For example, it is not possible to explain further a 
structure, where prime integer relations +7°-6° = 0, -5°+3° = 0 and +2°-l° = 0 
of level 1 form a prime integer relation 

+7 1 - 6 1 - 5 1 + 3 1 + 2 1 - l 1 = 0 

of level 2, which can self-organize itself into a prime integer relation 
+7 2 - 6 2 - 5 2 + 3 2 + 2 2 - l 2 = 0 

of level 3. However, this prime integer relation cannot progress further to level 4, 
because 

+7 3 - 6 3 - 5 3 + 3 3 + 2 3 - l 3 ± 0. 

It is shown that the correlation structures underlying (3) and (4) are built in 
accordance with the hierarchical structures of prime integer relations associated 
with the equations (5) and inequality (6) 2 , 5 , 6 . For example, the prime integer 



Figure 6. A hierarchical structure of prime integer relations and an isomorphic hierarchical struc¬ 
ture of geometric patterns. Due to the isomorphism the self-organization process of prime integer 
relations can be described geometrically and quantitatively. For example, we can see that geomet¬ 
ric patterns on different levels are self-similar. A prime integer relation can be measured by the 
area of a corresponding geometric pattern. 


relation +4° — 3° = 0 (Figure 3) corresponds to 

+2 • 4° - 2 • 3° = Ax 4 4° + Ax 3 3° = 0, 

which shows that space-time changes Ax 4 , Ax 3 of the elementary parts P 4 and P 3 
are correlated as A.t 4 4° = -Ax 3 3° and the parts form a composite part (P 4 *-+ 
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l \). The correlation through the prime integer relation does not involve a physical 
signal. But, if the dynamics Ax 4 of the elementary part I\ is specified, then the 
dynamics Ax 3 of the elementary part P 3 is instantaneously determined and vice 
versa. The correlation is nonlocal, because the prime integer relation does not have 
any reference to the distance between the parts. Similarly, the prime integer relation 
—2° + 1° = 0 specifies the correlation Ax 2 2° = — Axyl 0 between the elementary 
parts f-2 and Pi and a composite part (P 2 Pi)- In its turn the prime integer 
relation +4 1 — 3 1 — 2 1 + l 1 = 0, made from prime integer relations +4° — 3° = 0 
and -2° + 1° = 0, corresponds to 

(Ax 4 4 x + Aa^ 1 ) + (Ax 2 2 x + Axil 1 ) = 0, 
which shows that the composite parts (P 4 «-> P3) and (P 2 «-+ Pi) are correlated as 
(Ax 4 4 J + AX33 1 ) = -(AX22 1 + Axil 1 ) 

and form a larger composite part ((P4 <-*• P 3 ) <-» (P 2 <-» Pi)). 

In general, the self-organization process of prime integer relations can be asso¬ 
ciated with the formation of a correlation structure of the complex system (Figures 
3 and 4). The formation process starts with the elementary parts Pi6, ...,Pi and 
combine them into composite parts in order to make larger composite parts and so 
on until the whole correlation structure is built (Figure 4). 

By using the self-organization processes of prime integer relations a concept of 
complexity is introduced 2 and its applications may be found in 7 . 

5. Geometrization of the Self-Organization Processes and Fractals 
In the above considerations prime integer relations appeared like objects of forma¬ 
tion rather than objects of calculation. The prime integer relations might be better 
recognized as objects of formation, if they could be observed and measured as geo¬ 
metric patterns. Remarkably, by using the integer code series 3 , it is shown that the 
prime integer relations can be geometrized as two-dimensional geometric patterns 
and the self-organization processes can be described in terms of their transforma¬ 
tions 2 . These characterize the self-organization processes of prime integer relations 
geometrically and quantitatively. As a result we reveal fractal properties of the 
self-organization processes. 

Figure 5 illustrates the formation of a prime integer relation through the for¬ 
mation of a corresponding geometric pattern. A hierarchical structure of prime 
integer relations and an isomorphic hierarchical structure of geometric patterns are 
presented in Figure 6. The isomorphism allows us to observe fractal nature of the 
self-organization process of prime integer relations and investigate its scaling prop¬ 
erties. A prime integer relation can be measured by the area of a corresponding 
geometric pattern. 

In general, the geometric patterns of prime integer relations exhibit a variety of 
numbers with important properties. In particular, the PTM sequence is connected 
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with a self-organization process of prime integer relations progressing well through 
the hierarchical levels and demonstrating critical point 8 , 9 features 2 (Figure 6). 
This resonates properly with the fact that the PTM sequence gives a symbolic 
description of chaos resulting from period-doubling 10 in physical systems 11 . Al¬ 
though the PTM geometric patterns at levels n > 1 are bounded by intricate curves, 
they have, nevertheless, a concise and universal description. For example, the area 
of a PTM geometric pattern at level n > 1 can be simply specified as S = LH/ 2, 
where L and H are the length and height of the geometric pattern (Figure 6). As 
a result the PTM geometric patterns have scale invariant properties dividing the 
hierarchical levels into similar groups of 3 successive levels. 

Namely, the lengths and heights of the PTM geometric patterns at levels n — 
1,2,3 and n = 4,5,6 are described in terms of e and <5 as (2e, e<5), (4e, e 2 5), (8e, 2e 3 J) 
and (16e, 8e 4 5), (32s, 64e 5 <5), (64s, 1024s 6 6). By using the renomalization group 
transformation s' = 2 3 e, 6' = e 3 6, the lengths and heights at levels n = 4,5,6 can 
be expressed in terms of e' and 6' in the same way (2e', e'5'), (4e', e n 5'), (8e', 2e ,3 <5') 
as the lengths and heights at levels n = 1,2,3 are given in terms of e and 5. The 
situation repeats for levels n — 7,8,9 and so on. 



0 1/2 1 3/2 2 


Figure 7. Two geometric patterns as resonant vibrations of "integer string”. The first resonant 
vibration vi(t) = /M(t) represents prime integer relation +2° — 1° = 0 and the second resonant 
vibration 1/2(t) = jffFrepresents prime integer relation +4 1 — 3 1 - 2 1 + l 1 =0, where 
S = Pmes(x) e W eS [t 0 ,t2],x = +1 - l,p = p m€ s(x') € W eS [t' Q ,t^], x' = +l-1-1 + 1 and 
m = 0,e = 1,5 = 1. 

In many cases it is useful to interpret the geometric patterns of prime integer 
relations as resonant vibrations of ’’integer string” (Figure 7). 

6. Conclusions 

We have shown that complex systems can be described in terms of self-organization 
processes of prime integer relations. The processes have the integers as the basic 
building blocks and under the control of arithmetic make the prime integer relations 
of one level from the prime integer relations of the previous level. Prime integer 
relations demonstrate important properties in the description of complex systems: 

- May self-organize into another prime integer relations according to a single 
principle. A prime integer relation is more than the simple sum of the prime integer 
relations it is made of. A prime integer relation may participate in various self- 
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organization processes and as a result be a component of different prime integer 
relations at higher levels; 

- Do not stand alone, but through the self-organization processes are all inter¬ 
connected and inseparable in one hierarchical network. It seems that not a minor 
change can be made to any element of the network; 

- Provide nonlocal and instantaneous correlations between the parts of a complex 
system; 

- Can be described as two-dimensional geometric patterns and may be quantified 
in renormalizable numbers; 

- Provide a complexity order. The self-organization processes start with different 
integers and as a result progress to different levels producing the complexity order. 
It seems that a self-organization process aims to progress as higher as possible in 
the direction of this order. 

Finally, we have revealed the importance of prime integer relations as new el¬ 
ements in dealing with complex systems. The self-organization processes of prime 
integer relations describe complex systems by absolutely true information and can¬ 
not be explained in terms of deeper principles. This gives the possibility to develop 
an irreducible theory of complex systems. 
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The application of the multifractal formalism to the study of some time series with scale 
invariant evolution has given rise to a rich framework of models and processing tools for 
the analysis of these signals. The formalism has been successfully exploited in different 
ways and with different goals: to obtain the effective variables governing the evolution 
of the series, to predict its future evolution, to estimate in which regime the series are, 
etc. In this paper, we discuss on the capabilities of a new, powerful processing tool, 
namely the computation of dynamical sources. With the aid of the source field, we will 
separate the fast, chaotic dynamics defined by the multifractal structure from a new, 
so-far unknown slow dynamics which concerns long cycles in the series. We discuss the 
results on the perspective of detection of sharp dynamic changes and forecasting. 


1. Introduction 

The study of the statistical properties of economic time series is the focus of 
intense research in the last years 1,2 . There is a continuous development of new 
methodological tools for the characterization and processing of econometric vari¬ 
ables. This process is very important because it allows to create models to mimic 
the evolution of real systems and to identify the relevant mechanisms which govern 
their dynamics. 

Many time series of variables with econometric interest (as for instance stock 
market price series, option rates or foreign currency exchange rates) are known to 
exhibit multifractal properties 3 ’ 4 ’ 5,6,7 ' 8 . Apart from the typical statistical proper¬ 
ties of scale and translational invariance the main feature of multifractal systems 
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is that they can be decomposed into a collection of sets (the fractal components) 
arranged in a hierarchical manner. Under changes in scale a multifractal behaves in 
a non-trivial way, due to the combination of scalings of each fractal component, and 
leading to the emergence of a collective property known as multiscaling. Almost 
since the origins of the multifractal formalism, two basic different approaches have 
been established to deal with multifractal systems. One option is to carry out an 
statistical analysis on the symmetries of the system, the other is to investigate the 
geometric aspects derived from the decomposition of the system in fractal sets. 

Historically speaking the first approach is the most frequently used. It has 
allowed to develop a rich theory about multifractals, relating them with other prop¬ 
erties, as energy injection cascades, intermittency and anomalous scaling (see 9 for 
a discussion). Nevertheless it has some difficulties. Statistical approaches are very 
demanding in data (multiscaling distributions are highly curtotic) and, in addition, 
there is no intuition about the properties of series at any specific point. Some of 
these problems can be solved by using a geometric approach. Methods of this type 
are more technical since they require an efficient decomposition of the series in the 
different fractal components but they are more powerful and have many advan¬ 
tages, as we will discuss throughout the paper. Here, we will apply the geometrical 
approach to the analysis of foreign currency market data series. In particular, em¬ 
phasis is put on the most singular fractal component (from which the original series 
can be fully reconstructed) as well as on the concept of source, that allows to identify 
different dynamical regimes with different physical (economic) meaning. 

2. Reconstructible multifractals 

Let us start by giving a short theoretical introduction. To analyze a given temporal 
series denoted by s(t ) one defines a measure p of any set A , as 

KA) = j A dr |s'|(r) (1) 

where s'(t) stands for the derivative of s(t). The quantity fi(A) is a measure of 
the variations in the series s(t) across the set A. The measure p, allows to locally 
characterize the scale invariance of the fractal components. We will say that a time 
series s(t) is multifractal if for any At and any time instant to 

ft ([*o- At/2, t 0 + At/2}) = a 0 At d+h ° + 0(At d+h °) (2) 

where ho is a local exponent depending on the point t 0 considered and the shift d 
in the scaling has been introduced by normalization convenience; it corresponds to 
the dimension of the space of variables (d, = 1 in our case) 10,11 . When a measure 
H is multifractal, a scaling exponent ho can be assigned to every point to which 
defines how changes of scale are locally performed. These local scaling exponents 
are referred to as singularity exponents because they characterize the functional 
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character -i.e. smooth, continuous, singular...- of s(t) at each one of its points. 
Any technique assigning a singularity exponent to every point in the series is called 
singularity analysis. The obtention of the singularity exponents at each point of 
an experimental, discretized series require of an appropriate interpolation scheme 
and of some filtering capabilities, all that usually attained by the use of wavelet 
projections 12,13,11,10 . 

Once singularity exponents are known at every time t (which we will represent 
by the function h{t)), it is possible to classify points according to common values 
of the exponents. We define the fractal component Fh associated to the singularity 
exponent h as the set of points verifying Fh = {h(t) = h}\ thus, those points 
for which local changes in scale are performed in the same way belong to the same 
fractal component. Once Fh are obtained, their fractal dimensions D{h) can be 
calculated. This function, known as the singularity spectrum of the multifractal, 
plays a central role in the connection of geometrical and statistical properties of 
multifractals: the famous Parisi-Frisch’s formula 14 express the multiscaling expo¬ 
nents obtained in the statistical approach in terms of D{h). Hence, series can be 
classified according to D{h). 

The singularity spectrum of a physical multifractal signal is always bounded 
from below, that is, there always exists a finite minimum singularity exponent 
hoc since physical signals cannot display divergences to infinity. The existence of 
a lower bound for the singularity exponents have deep consequences for natural 
multifractals, as the related fractal manifold is very informative about the signal. 
We will call the fractal manifold associated to the most singular {i.e., smallest) 
exponent h <*> the Most Singular Manifold (MSM) of the multifractal hierarchy, and 
we will denote it by Foo {i.e., F^ = Fh 00 ). The MSM corresponds to rare events 
in the distribution of singularities, located at the tail of that distribution. But in 
spite of being unlike events, the dynamics of the series is lead by the MSM 10 . In 
fact, based on the statistical interpretation of the MSM 16 it has been proposed 
that multifractal signals with lower bounded spectra can be reconstructed from 
the values of the gradient of the signal over the MSM. An explicit reconstruction 
formula was derived 16 , that for the case of ID series takes the following form 10 : 

s{t) = s{0 ) + f dr s'{t) (3) 

Jo 

Equation (3) must be understood as an integral with respect to the Hausdorff mea¬ 
sure associated to the MSM (we assume that the MSM is a regular fractal 15 ) of 
the values of the gradient of s restricted to the MSM. Although when this expres¬ 
sion is applied to real, discretized signal it gives a stepwise approximation to the 
data, in theory more complex behaviours could be obtained from it. One of the 
consequences of the existence of MSM and its relevance in terms of reconstruction 
is that multifractal series are structured objects, containing points which convey 
more information than others. In addition, the series can be described in a more 
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simplified way since the whole set of events can be coded in terms of the MSM, very 
useful for compression purposes 16 . 

3. Data. Performance of the reconstruction algorithm 

For this work, we have made use of several series obtained from the foreign currency 
exchange market for some important currencies, sampled at a daily rate starting 
in January 1st, 1992 until December 31st, 1999. All the illustrations in this paper 
have been done for the Euro-US Dollar exchange rate. We consider the logarithm 
of the exchange rate, because in such a way the gradients approximate the relative 
variation in the exchange rate, what is the econometrically relevant quantity. 

As a first step, we computed the singularity exponents associated to each time 
instant in the series by means of wavelet projections; see the details in 10 . When 
defining the fractal components on real data, we should accept an experimental 
quantization in the singularity determination Ah, which express the experimental 
uncertainty in the value. Previous works 11,10 show that quantizations of order 
Ah = 0.1 are acceptable for multifractal decomposition. For reconstruction task, 
a more exigent choice is necessary in order to attain reasonable reconstructions 
qualities. For the experiences in this paper, we fix a rather coarse determination 
of the MSM comprising the 30% of the singular points; such a amount guarantees 
good reconstruction qualities and efficient analysis of the series structure. 

4. Reduced series 

The MSM can be employed to generate a new type of signal, which is only concerned 
with the presence of the MSM: the reduced signal. The reduced signal r(t) is 
generated when the reconstruction formula is applied to a simplified version of 
the derivatives: only the sign is kept. Hence, we take r'(t)\ Foo = sign {s'(t)) and we 
assume that r is a multifractal reconstructible signal, so we apply Eq. (3) to retrieve 
r(t). Once the reduced series is constructed, we can observe that there is a striking 
similarity between the original and the reduced series. Compare Figs. 1 and 2, left: 
a visual inspection of the graphs reveal that the reduced and the original series 
have locally the same shape, just different on the size or amplitude of the observed 
structures. This correspondence reaches further: the equivalence of multifractal 
structures for both series can be theoretically granted, assuming that the values of 
|s / | change smoothly over the MSM 17 . Nevertheless, there are points where sudden 
differences are observed, and for which multifractal structures do not coincide. To 
understand the nature of these transitions points and to characterize them in a 
systematic way we need to introduce the concept of source. 

5. Sources 

Sources are introduced in order to provide a consistent theoretical background in 
support of the hypothesized continuous function which seems to relate the series s 
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Figure 1. Original series of the logarithms of EUR-USD currency exchange rates (+) and its 
reconstruction from the MSM at 30% (x). The series is reconstructed in accumulated error, Eq. 3, 
and for that reason error increases with time. 

and its reduced counterpart r. We look for a function p(t) (that we will call the 
source function) which is continuous and relates the derivatives of the original series 
s and its reduced counterpart r, in the way: 

s'(t) = p(t)r'(t) (4) 

Equation (4) has a crucial importance, as it gives an explicit representation of the 
original series as a combination of sources and reduced series. We can integrate 
both sides of the equation to obtain a new reconstruction formula, in the way: 


s(t) = s(0 ) + f dr p(r) r'(r) (5) 

Jo 

This equation is in fact a generalization of the MSM-based reconstruction formula, 
Eq. (3), in which we have made explicit the separation between the continuous 
and the multifractal parts. The question is now how to obtain the source function 
p(t). If we assume that both the signal s(t) and the reduced series r(t) define 
multifractal measures (denoted p s and p r ) with the same singularity exponents, 
Eq. (5) can be interpreted in terms of Riesz’s representation theorem 18 , in which 
the measure p s is represented in terms of p r : p s {A) = J A dp, r (T ) p(r) \/A. We 
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can evaluate the integral density p(t) as the Radon-Nikodym derivative of p, s with 
respect to p, r . Notice that if p s and p r have the same singularity exponents then 
H„{[t - At/2, t + At/2]) ~ At d+ ' , (‘) ~ p. r ([t- At/2, t + At/2]) and so both measures 
are absolutely continuous respect to each other 18 . The density p(t) can hence be 
obtained by taking sequences of intervals of diminishing sizes, 


P(t) 


p s ([t - At/2,t + At/2]) 
a™o p r ([t - At/2, t + At/2]) 


The density p(t) is called the Radon-Nikodym derivative of p s with respect to p r 
(sometimes represented by the symbol jpf-), and we can identify it with the source 
field: Equation (6) yields Eq. (4) when the derivatives of s and r are continuous. 
Unfortunately, a direct application of Eq. (6) over experimental data is not easy 
and demands special care 17 . In a previous study over stock market data 17 the best 
method to evaluate the source field leads to hypothetize that the sources form a 
stepwise function. In this way, one relaxes our initial assumption of continuity on 
p to piecewise continuity. The piecewise continuous model we propose here is the 
simplest one, namely piecewise linearity: for each source domain A we have 


what implies 


s(t)=a A r(t) + b A Vt€A 


( 7 ) 


p(t) = a A Vt € A (8) 

so that sources are stepwise (constant over each region; see 17 for a description on 
the iterative method to retrieve the source domains). There are many advantages 
respect to other strategies. It gives access to more regular source function p by 
definition ( i.e ., they are piecewise constant). It gives more importance to regions 
than to points. The stepwise method is stable with respect to discretization. When 
the MSM is calculated at different densities (that is, with different quantizations), 
the associated stepwise sources have a very similar aspect, i.e., stepwise method 
is stable with respect to the quality in the determination of the MSM. Moreover 
piecewise constant sources grant the correspondence of multifractal structures of s 
and r: indeed, p s = a A p r over A, so the singularity exponents coincide. In Figure 2, 
right, we show the sources calculated for our example series. Finally, the quality of 
the reconstructions obtained by combining the reduced series and stepwise sources 
is very good, even using a small number of source domains {Ai}i =1 The results 
are shown in Figure 3. 

When the sources are described in terms of piecewise continuous functions the 
series introduces some transition points (i.e., the limits of the source domains) 
in which sharp changes take place. For the rest of points, data series are just a 
rescaled version of their reduced counterparts. Henceforth, the frontiers of source 




Figure 2. Left: Reduced series ; Right: Stepwise sources for EUR-USD daily series (with N = 10 
temporal domains) 



Figure 3. Original series of the logarithms of EUR-USD currency exchange rates (+) and its 
reconstruction applying sources (x); PSNR: 28.69 dB 

domains have a dynamical interpretation: they are the transition points at which 
the economical system changes its behaviour. Those points are probably outside 
of the multifractal paradigm, as we can identify the multifractal structures of the 
original and the reduced series except for those points. Transition points in sources 
can probably be interpreted as too singular points in which statistics of temporal 
series deviates from multifractality, so they should be studied separately. Transi¬ 
tion points are very relevant in order to understand changes in the dynamics of the 








system; for instance, in other contexts as for instance meteorology the presence of 
transition source points have been related with the presence of convection currents, 
precipitations and other effects related with strong energy exchanges 19 . In our con¬ 
text, source plateaus are very close in value and transitions have small amplitudes, 
in contrast to what is observed in the study of stock market series 17 . A possible 
interpretation of source values and its transitions is the following. Let us consider 
the constant value a A at each source domain A. By definition (see Eq. (4)) the 
absolute values of the derivatives of the series over the MSM equal that constant. 
The constant a A represents then the maximum expected change per unit of time 
during the whole domain A. In this sense, a A gives a measure of the maximum 
volatility 3 over that period: the volatility a(t 0 , At) at a given time to and over a 
window length At will be given by: 


a(to, At) = a A cr r (to, At) (9) 

where <r r (to,At) is the volatility for the reduced signal, that we will call reduced 
volatility. Taking into account that at any time step the reduced series can change 
at most by 1, cr r (t 0 ,At) < At. According to our model, it follows that at each 
source domain a(t 0 , At)/At < a A , which is consistent with the interpretation of a A 
as maximum volatility per unit of time given above. 

In spite of the simplicity of the reduced signal, in our model the volatility is a 
complicated, random variable because the reduced volatility itself is random. The 
reduced volatility depends on local variations in tendency (which depend on the 
particular basis point to as well as on the size of the window extent At), on the 
Markov parameters characterizing the reduced series 10 (which in turn depend on 
the particular source domain A containing t 0 ) and in the multifractal structure 
(which does not evolve but may depend on the particular series we are studying; 
however this later dependency is integrated in the Markov parameters and does 
not require a separate study). An interesting prediction of our model is that all 
cycles and variations of volatility are also cycles and variations of reduced volatility, 
as both volatilities just differ in piecewise constant scale factors. In Figure 4 we 
observe that such prediction is correct over our example series. Notice that the very 
similar values in the source plateaus observed for the Euro-US Dollar exchange rate 
would imply that this market has a rather constant distribution of volatilities. 


6. Conclusions and future work 

The experimental evidence confirms that relevant econometric variables, such as 
volatility, can be characterized over long periods (the source domains) by the re¬ 
duced series, which just contains geometrical information. The results confirm the 


a Here we define the volatility at a given point as the standard deviation of values of series for a 
window of fixed size around that point. 
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Figure 4. Volatility time series for the original data (continuous line) and the reduced counterpart 
(re-scaled by a factor 0.01 to fit the graph; dashed); At = 100 ticks. Notice that we can identify 
the same cycles for both volatility series, in agreement with theory. 

importance of the MSM, as this set characterizes completely the reduced series. 
Any model for the volatility should primarily consist of a model for the reduced 
series (as the one presented in 10 ). The sources have an important role, also. Ac¬ 
cording to our model, Volatilities must be recalculated once a transition point is 
crossed: following Eq. (9), the constant relating the reduced volatility with the 
actual volatility changes after each transition - as it is the source term. This fact 
makes the detection of transition points crucial. 

The results presented here are obtained on the basis of a descriptive analysis, 
that is, the structure and the properties we have isolated are obtained by analyzing 
the series a posteriori : when processing a time instant in the series, we take into 
account both the past and the future times. But there is nothing in the multifractal 
formalism which prevents the use of unilateral intervals to analyze local scalings as 
in Eq. (2): namely: 


p([to - At/2, t 0 ]) = a 0 At d+h ° + 0(At d+ho ) (10) 

Preliminary results on this type of prospective analysis ( i.e ., oriented to the pre¬ 
diction) shows that the determination of the multifractal structure is still possible, 
although the experimental uncertainties increase, specially in the detection of points 
in the MSM. Timely detection of the MSM have relatively important uncertainties, 
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which decay fast as time passes and the point under study is further in the past of 
the last accessible point. 

Concerning prospective detection of source domains, a new algorithm needs to 
be define, as the one presented 17 is by construction strictly descriptive and the 
determination of source domains is made in a global basis and not locally. This is 
an important limitation of the algorithm which is not intrinsic to sources; in fact, 
sources are local, as they correspond to the Radon-Nikodym derivative. New stable, 
unilateral methods for the obtention of sources on experimental, discretized data 
need to be implemented. 
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This text- identifies some fractal sets generated by noninvertible maps. Two 
topics are presented: the fractal ” box-within-a-box” bifurcations structure (de¬ 
scribed in 1975), produced by a diml unimodal map, and the fractalization of 
basin boundaries generated by plane noninvertible maps. Some bifurcations of 
fractalization are described, depending on the basin boundary situation with re¬ 
spect. to the critical curve (locus of points having two coincident preimages), 
and to the nature of strange repellers. 

Keywords: noninvertible map, fractal set, stability, basin, bifurcation. 

1 Introduction 

The dynamic systems considered in this paper are described by a ” discrete” equa¬ 
tion, the solution of which is a sequence of points (orbit, or discrete trajectory) 
determined by an initial point (initial condition). The model of many processes 
are of such a type, called recurrence relationship (or simply recurrence). The cor¬ 
responding explicit form is written: 

X n +i = F(X n ,A), n = 0,1,2,... X(n = 0) = X 0 (1) 

Here X n is a real phase (or state) vector, dimX — p, A a real parameter vector, 
the sequence of integers n is related to a discrete time, Xo is the initial condition, 
F a single-valued smooth function of X n . Depending on the scientific field such an 
equation is also called iteration , or map, or point-mapping. In this text (1) will be 
called map, denoted T. Its equation is symbolically represented by X n+ i = TX n , 
or without lower indices X' = TX. 

The point X' (or X n+ i) is called rank-one image of X (or X n ). The map X n+r = 
F r (X„, A) deduced from (1) after r iterations is denoted T T , X n+r = VX n , X n+r 
being the rank-r image of X n . Considering the inverse map, the point X — T~ x X' 
belongs to the set of rank-one preimages of X'. When T is noninvertible this set 
may be either made up of several points, or of only one point., or void. Then the 
phase space (defined by X) is made up of open regions Z*, each point of a region Z» 
having i distinct rank-one real preimages, i = 0 corresponding to a region without 
any real preimage. A point X n belongs to the set of rank-r preimages of X n+r . The 
simplest illustration of noninvertible map is given by the quadratic one-dimensional 
example (p =1): x' = x 2 — A (Myrberg’s map), A being a parameter. The inverse 
map T~ l is given by x = ±y/x‘ + A. So the x-axis is made up of the intervals Z 2 
( x' > —A), Z 0 (x 1 < —A). The boundary point x' = —A, which has two merging 
rank-one preimages at x = 0, is called critical point (in the Julia-Fatou sense). 
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The solution of (1), for the initial condition X(n = 0) = Xq, is a sequence of 
points: 

X n = X(n, X 0 , A), n = 1, 2, 3,. (2) 

X n is called iterated sequence, or discrete phase trajectory, or orbit. In general 
X(n. Xr h A) is a non classical transcendental function, which only the qualitative 
methods of nonlinear dynamics can characterize. In this framework a meaningful 
characterization consists in the identification of the X(n, .Yq, A) singularities, and 
the behavior changes of the latter ( bifurcations ) when A varies. The simplest sin¬ 
gularities are the zero-dimensional ones: period k cycles, denoted also k-cycles. A 
k-cycle is a set of k consecutive points X*, i — 1,2. k, permuting by successive 
applications of T, such that: X* — T k X*, with X* ^ T r X* for 1 < r < k. When 
k = 1 the point X* is called a fixed point (period one cycle). A cycle is characterized 
by p multipliers Sj, j = 1. ...,p, which are the eigen-values of the associated Jaco¬ 
bian matrix. It is locally attracting (asymptotically stable) iff all \Sj\ < 1. Only 
one |5j| < 1 is sufficient to make repelling (or unstable) a cycle. When \Si\ < 1. 
I — 1,..., m, |5 r | < 1, r — m + 1. ...,p, m — 1, ...,p — 1, the cycle is a saddle. When 
all |Sj| > 1 it said expanding. A period-A: cycle is identified by the symbolism ( k,j }, 
j being an index which characterizes the permutation of the fc-cycle points by k 
successive applications of T. This index permit to differentiate cycles having the 
same period k and issued from different bifurcations (two cycles corning from the 
same bifurcation have the same points permutation). When p > 1 other classical 
singularities are stable and unstable manifolds of saddle cycles, basin boundaries, 
various invariant sets [1] [2]. 

The text matter is devoted to fractal sets generated by one and two-dimensional 
noninvertible maps (p — 1,2). Noninvertible maps generate the classical singular¬ 
ities of the invertible case (the inverse exists and is unique), i.e. fixed points, 
period-fc cycles, k = 2, 3,when p > 1, stable and unstable manifolds of a saddle 
point when p > 1. Nevertheless such maps T give rise to a new type of singularity 
the critical set CS (point if p = 1, curve if p = 2) the branches of which (except 
some particular cases) are the boundaries of the open Zj regions. Noninvertible 
maps T can be identified according to the organization of the regions Zi. The sim¬ 
plest maps are of (Zo — Z 2 ) type (the space is divided into two unbounded regions 
Zq and Z '2 separated by CS), and [Z\ — Zg — Z\) type (the space is divided into 
three unbounded regions: one Z-a, bordered by two regions Z\). More complex 
types are described in [l]-[3]. The set CS is defined as the locus of points such 
that two determinations (rank-one preimages) of the inverse map T -1 are merging 
on a set CS- 1 . When the map is smooth, CS -1 is obtained by equaling to zero 
the Jacobian determinant of T. The critical set plays a fundamental role in the 
solutions behavior and their bifurcations. 

This paper essentially deals with two topics. The first one concerns the fractal 
” box-within-a-box", or " embedded boxes ", bifurcations structure generated by a one- 
dimensional unimodal map (i.e. a Zq - Z 2 map), with some short informations on 
its extension to multi-modal maps (having intervals 2).with i > 1) This structure 
was described for the first time from properties of self-similarity in 1975 [4] [5! 
before the introduction of the word ” fractal”. The second topic is related to the 
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basin boundary structure of an attracting set. when this boundary is fractal, in the 
case of plane noninvertible maps T (p — 2). i.e. CS is now a critical curve LC. 
For the maps class considered here, it is about to show some typical situations, 
and to explain the conditions of their birth with parameter variations giving rise to 
nonclassical bifurcations. As for nonfractal basin boundaries, these bifurcations are 
characterized by a common feature: contact of the basin boundary with the critical 
set. Even if the structure of LC is simple, the basin boundary is generally very 
complex with a large variety of geometrical situations, which leads to a large variety 
of contacts and fractalization features. The basins generated by plane noninvertible 
maps may be either simply connected, or multiply connected , or non connected, 
depending on the place of the basin boundary with respect to the critical curve LC 

[1] [2]. This dependence occurs in many different ways. It is reminded that the 
basin is multiply connected when it is pierced by holes, here called lakes. When 
it is nonconnected it is always made up of areas (here called islands) without any 
connection, the area containing the attractor being the immediate basin. 

The fractal properties of a basin boundary are defined from a basic fractal core 
called strange repeller SR, which belongs to this boundary. It is constituted by 
a nucleus made up of infinitely many infinite sequences of unstable cycles with 
increasing period, their limit sets when the period tends toward infinity. The re¬ 
maining part of SR consists of the increasing rank preimages (arborescent sequence) 
of all these points. When lakes, or islands, have a fractal structure, they are in¬ 
finitely many and SR is their limit set. The knowledge of fractal properties of a 
basin boundary necessitates the identification of its related strange repeller, and 
the follow up of its birth conditions. The repeller SR may be located on a dim 1 
manifold of the plane map T, considering the restriction (a noninvertible dim 1 
map) Tj. of T to this manifold. In this sense the bifurcation structure generated 
by T r plays an important role in the SR identification when p = 2. The strange 
repeller also may come from the destruction of a chaotic attractor not located on a 
dim 1 manifold, it may be also generated from a perturbation of a Julia-Fatou set 

[2] [6], and for some maps families all these different types of strange repellers may 
coexist. It is worth noting that SR gives only the basic fractal properties of a basin 
boundary, a same type of SR leading to various types of basin boundaries. Then 
further information on the basin characteristics are obtained from the geometrical 
situation of the critical set LC with respect to a basin boundary. 

Section 2 is a succinct presentation of the fractal "box-within-a-box" bifurca¬ 
tions structure generated by diml unimodal maps, with the related symbolism. 
Section 3 is devoted to singularities and bifurcations specific to plane noninvertible 
maps. Two examples of basin boundary including a strange repeller SR of a dim 1 
map are given in sec. 4. Section 5 presents an example for which SR, comes from 
the destruction of a chaotic attractor. The case of a strange repeller resulting from 
the perturbation of the Julia-Fatou set of the complex map z' = z 2 — A is the sec. 
5 object. 



2 Box-within-a-box bifurcations structure of dim 1 noninvertible 

maps 

2.1 Rundown of basic properties 

The " box-within-a-box " (translation of " holies embotties " in French) bifurcations 
structure is generated by noninvertible one-dimensional maps. Its first description 
was given in [4] [5] before the word ’’fractal” was introduced, the situation being 
described by the sentence ” the whole is similar to the parts even if they are infini¬ 
tesimal” . Quoting these publications Guckenheimer called it "embedded boxes" [7]. 
After this structure has been also presented more completely in the books [2] [6] 
[8] [9]. It is characterized by the fact that the fractal organization of bifurcations 
is known by identification of non classical bifurcations resulting from the merging 
of two singularities of different nature (critical points and cycles points). The basic 
fractal bifurcation structure is generated by unimodal maps (i.e. defined by a func¬ 
tion having only one extremum, a Zq — Z 2 map). The simplest case corresponds to 
the quadratic map, 

T : x' — x 2 - \ (3) 

Here x is a real variable, A a real parameter. Such a map, called Myrberg’s map 
[1.0] is defined by a parabola with an ordinate minimum C -1 (a; = 0), its rank-one 
image C — T(C'-.i) being the rank-one critical point of T. The inverse map T~ l is 
defined by x — ±sfx' + X. The map T is characterized by the following properties. 

- (a) All the bifurcations values of (3) occur into the parameter interval fii — 
[A 0)o ,A[], called overall box, A^),, = —1/4, A* = 2. For each A-value, —1/4 < A < 2, 
the map generates a unique attractor (a stable fixed point, or a stable period k cycle, 
or a chaotic attractor). The value A(i) 0 = —1/4 corresponds to a fold bifurcation 
giving rise to two fixed points i — 1.2, with multiplier S — 2x(g,;): q\ always 
unstable (5 > 1), and g 2 (S < 1, attracting when —1 < S < 1). No real fixed 
point exists for A < A(i) 0 = —1/4. The value A = A] = 2 is a basic non-classical 
bifurcation resulting from the merging of the unstable critical point q\ with the 
rank-two critical point C\ = T(C) = T 2 (C_i). It is characterized by the relations 
x(C'j) = x(qi) = 2, x(C) - x(qf 1 ) = —2, T _1 (gi) = qiUqf 1 . When 0 < A < A] the 
invariant segment [gf 1 , gi] is the closure of the basin of the absor bing segment CC\, 
which contains the unique attractor. When A = A[ the segment CCi is chaotic and 
merge s wit h [qf 1 , gi], all the possible cycles have been created, they belong to CC\. 
Then CC\ is invariant but not, absorbing. An initial condition xq on this segment 
gives a bounded orbit, belonging to the interval [gjj -1 , gi], orbit very sensitive to 
very small changes of xo- The repelling cycles and their increasing rank preimages 
constitute a real set (E), occupying the whole interval [—2 < x < 2], the derived set 
(set of limit points) (E 1 ) of which is perfect. The preimages of ( E ) are everywhere 
dense on (E') (see more details in [6] [8] [9]). 

For A > 3/4 the fixed point g 2 is always repelling with S(q 2 ) < -1 and a 
period-fc = 2 cycle, made up of two points q 2 i, i = 1,2, having the multiplier 
S(q2i) — 4 — 4A, emerges from g 2 - The value A = An = 3/4 corresponds to a flip 
bifurcation. New increasing values of A generates a sequence of flip bifurcations for 
A — Xbm related to period 2* cycles, i = 1,2, with an accumulation value 



87 


Um. 1 „- +cc Xbm — Aj s ~ 1.401155189 [10]. For A < A ls the number of repelling 
cycles is finite. They have the period 2 TO , and have been created after crossing 
through each A<, m value. For A > A ls infinitely many repelling period 2' cycles 
(i = 0,1,2....) exist, and they constitute a fractal set. Myrberg calls spectrum 
the parameter interval uq = [A(i) 0 ;A ls ], here related to the sequence (cascade) of 
bifurcations by period doubling from the fixed point ® {'<■ = 0). 

- (b) The number N k of all possible cycles having the same period k, and 
the number N\(k) of bifurcation values giving rise to these cycles, increase very 
rapidly with k (for more details cf. [9]). Cycles with the same period k differ 
from one another by the cyclic transfer (permutation) of one of their points by k 
successive iterations by T. Then a period fc-cycle is identified by the symbolism 
(fe; j), j being an index characterizing this cyclic transfer. Considering one of such 
cycles, it can be generated from tw r o basic bifurcations: either a fold one, or a 
flip one. A fold bifurcation generates two basic cycles at A = A| fc)o : (k]j)s>i&nd 
(k;j)s< i, k 2. With increasing values of A, from the cycle (k-,j)s<i a flip 
bifurcations cascade occurs for (fc2*; ji)s<i cycles with accumulation at a value 
X J ka when i —*• oo, 2 > X ka > Aj,. Myrberg also calls ” spectrum” the parameter 
interval uP k — [A^ o ;Aj[J, k = 1,3,4,..., made up of parameter intervals leading 
to attracting cycles of period k2 l , i — 0, 1,2,.... The cycle symbolisms (k\j) and 
(&2‘; ji) correspond to what is called a nonembedded representation in [2] [9]. 

When A > AJ = 2, [r/f 1 , q{\ C CC\ , the only attractor is the point at infinity, and 
no bifurcation takes place. The set (E) (without the point at infinity) constitutes 
the non-wandering set ( E) £ [qi^ qxj. All the possible cycles have been created by 
(3). They are real and repelling, (E) is completely disjointed, and is a Cantor set. 
The situation equivalent to the AJ one (but now with an attractor inside CC\ ) is 
met for a (k\j) cycle with multiplier S > 1 (thus generated by a fold bifurcation), 
for a parameter value denoted Aj? . In this case Aj* is the least A- value such that 
the critical points C k = T k (C), C k + 1, .... C^k-i merge into the k points of the (k;j) 
cycle with S > 1. By consideration of T k the value X*J reproduces qualitatively 
the situation of T when A = A*. Differently from A = A*, for A^ the map T 
generates k attracting segments constituting a period-k chaotic segment which is 
now absorbing. 

2.2 Description of the structure 

The fractal ’’box-within-a-box” structure, here defined for the map (3), concerns 
all unimodal maps (Z 0 — Z-i ones) with correctly chosen parameter variation. This 
structure is of ’’Russian dolls” type. It considers the parameter interval fl t == 
[A(i), ; , > A*] (overall box) inside which all the possible bifurcations occur. Out of Qi 
no bifurcation happens, fli is generated from the two basic period k = 1 cycles, i.e. 
the fixed points q k and q 2 . Taking into account the Myrberg’ spectrum u>i related 
to the fixed point qo (S < 1), the box Qj is defined by: 

fix = [A ( i )o> XI) = ut U Ax Ax =)Aia, AJ] 

Note that the symbolism ”2 l ” excludes even period cycles born from a fold 
bifurcation, or a flip bifurcation related to a basic cycle appearing out of uq (2 2 ^ 4, 



2 s ^ 8, with such a symbolism). So cycles different from (2*; ji) can appear only 
for A 6 Aj. For A < A(,) 0 = —1/4 the map has neither fixed point (except the 
point at infinity) nor cycles, every orbit is divergent. For A > AJ = 2 all the 
possible period k cycles have been created. They are repelling, and the map has 
the properties indicated in sec. 2.1. 

Two period-fc (k, = 3,4,...) basic cycles ( k\j ), one with S > 1, the other with 
S < 1, generate a. parameter interval, provisionally denoted fi*, having the same 
behavior as QC A,. If Q k is not contained into another interval fl k ' , k being 
a multiple of k' , is called rank-one box , or box ( k;j ) ( embedded representation). 
It is denoted flf. with: 


fii = Aj =]Ai s , A?], Q{ = 4 U A{ c Ax 


Here u) 3 k is the spectrum (k;j). Then for T k the box iV k reproduces all the 
bifurcations contained in the box Qj, in the same order (self similarity property), 
for a set of cycles having periods multiple of k. Denote one of such boxes. 
Inside Q 3 ki it is possible to define rank-two boxes ^ k f% — [A|^^ o , C A^, 

related to two (ki.faji, jh) basic cycles, which for (T kl ) k ' i undergoes in the same 
order all the bifurcations of the box Cl 3 ki , and so those of Hi: 


c A{;, A?,'; 


Mor e generally it is possible to define rank-a boxes, embedded into a rank-(a — 1) 
box 


K:± = felv*;S:::£i = <:± u K:± c 

So Q? kl '"*k a c nj. 1 "(’J*" 1 , a = 1,2,.... The boundary parameter A* of each of 
these boxes (a — 1,2,...) is defined from the the merging of well defined critical 
points with a repelling basic cycle having the multiplier S > 1. They are called 
boxes of first kind. The representation of these boxes is given by Fig. la, with the 
enlargement of Fig. lb. 

Other type of parameter A* can be also defined from a repelling cycle with S < 
— 1, born from a flip bifurcation. Then when A = A^., * = 1,2, ..., k = 1,3,4,..., 
k2’~ l critical points of well defined rank merge into a period k2 t ~ 1 cycle with 
S < — 1 (born from a flip bifurcation). We call box of second kind, a box denoted 
Q J k2i which has A^ 4 as one of the two boundary points (cf. Fig. lc for k= 1). The 
second boundary point is the flip bifurcation A = 4k2 i l ■ parameter generating the 
attracting cycle (fc;2 l ). When * —» oo, the two boundaries tend toward \ ks , with 
Ajjjji > X 3 ks . The first and largest box of second kind is = [Afti, A$i], (A: — 1) 

corresponding to Cfe = q-2- Figure 1 represents the whole ”box-within-a-box” (or 
embedded boxes) bifurcations structure. It is fractal because the boxes are self 
similar, i.e. the organization of the set fix is similar to that of its parts (the above 
defined boxes), even if these parts are infinitesimal. 
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Figure 1. B ox- with in-a-box (or embedded boxes ) bifurcations structure. 


2.3 Properties 

The box boundaries satisfy the following properties: out of £2j., A < A^ b , the value 
A| fc j o is a limit point of boxes U 3 k , for k' —* oo, with A > X k 3 the value \* k J is a limit 
point of boxes Q? k „ when fc” —> oo. Considering the map (3) and increasing values 
of the parameter A. the multiplier S of a cycle (fc; j)s>i increases and the multiplier 
S of a cycle (k; j)s<. .i decreases. So these cycles become more and more repelling. 






and they cannot disappear by bifurcation. The following properties results: 

- (a) Let [k.j} (nonembedded representation), k — 1,3,4,..., be the given basic 
cycle of the box Q k with S < 1. For A > X k/j , U 3 k has generated a Cantor set 
Cs[k,j\ made up of all the repelling (k2 l ,ji)-cycles, i — 0,1,2,.... with multiplier 
S < — 1, bom from the flip bifurcations of uP k . 

- (b) Let (ki]ji) (embedded representation) be the basic cycle (S < l) of 
the rank-one box f l 3 ki . For A > AJ.j 1 , the box has generated the Cantor 
set Cs[ki.ji\. and infinitely many Cantor sets, Cs[kik2\ji,fa]> • ••> Cs\kik'2...k a : 

■■■)„], ■■■, a= 1,2,.... oo, from the infinitely many boxes (with fractal organi¬ 
zation) embedded into Q 3 ^. 

- (c) For A > X* k 3 ) . the map T (thus not only 0^) has generated infinitely 
many Cantor sets related to the infinitely many boxes created for A < X k 31 . For 
A < Xj ki ^ the map has generated infinitely many Cantor sets related to the infinitely 
many boxes created for A < A^, . 

- (d) For A > A*, T has generated all the possible Cantor sets, related to ail 
the basic cycles of T, from the infinitely many boxes embedded into the over all box 
0 ] * 

Denote A^, the fractal set resulting from the union of all the above Cantor 
sets, and cycles with S > 1, k > 3, including their limit points, generated for 
A > Ai s . This set satisfies the property AJ C CCu and its structure is well defined 
from the knowledge of the: Fig. 1 structure. When A ls < A < A*, the set A\ 
constitutes the nucleus of a strange repeller S R, ma de up of and its increasing 
rank preimages. From the initial point x 0 6 CCi\A* x , n iterations, n < N (N 
depending on xq) give rise to a chaotic transient, followed by a regular convergence 
toward the attractor of T. When A > Aj, and Xo Gjgf 1 , (/i[\A^, the set i\“ x generates 
for n < N a chaotic transient occurring in the interval and for n > N the 

orbit diverges tending toward infinity. On the rr-axis, the repelling cycles, and their 
limits for the period k —> oo, have a fractal organization when A > Ai s . For each 
point of the parameter A-axis, A > Ai*, the fractal structure of the map singularities 
is completely identified from the box-within-a-box bifurcation structure. Consider 
A e cu k , with A sufficiently near Xj k)0 for giving an attracting cycle (k;j). For the 
map T k this cycle gives k attracting fixed points Pi, i — l,...,k, each of them with an 
immediate basin Do(P»), and a total non connected basin D(Pj) — U„>oT _n Aj(Pi)- 
The basins D(P,) are fractal, and have SR as a common limit set. 


2.4 General occurrence of the embedded boxes structure 

As said in sec. 2.1 the embedded boxes structure generated by the Myrberg’s map 
T (3) also occurs for other types of unimodal maps. Particularly in the case of 
the general form of quadratic map y' = ay 2 + 2 by + c a linear change of variable 
y = ax + B leads to (3) with A ~ b 2 - ac - b, aa — 1, afi — —b. Moreover 
bimodal maps (with two extrema, i.e. (Z1 — Z3 — Z1) maps) create such bifurcations 
organization related to each of the two possible attractors (cf. p.401-418 of [6]). 
For multimodal maps locally this organization exists. 

The fractal embedded boxes structure described in secs. 2.1-2.3 shows that if 
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the Myrberg’s map gives a cycle with a period different from 2*. * = 0,1.2,... (note 
that 2 2 ^ 4, 2 3 8) then T generated infinitely many repelling cycles and their 

limit, the whole constituting the nucleus of a strange repeller (see end of sec.2.3). 
This property occurs for all multimodal maps. It gives a test permitting to conclude 
to the presence of a strange repeller SR. In the case of a plane map T, if such a 
cycle exists on a dim 1 manifold, we can say that it contains a strange repeller, 
generated by the dim ! map resulting from the restriction of T to this manifold. 


3 Singularities and bifurcations specific to plane noninvertible maps 
3.1 Critical sets. Chaotic areas 

With respect to invertible case the noninvertibility of a map T gives rise to a 
singularity of a different nature: the critical set. The rank-one critical set CS is the 
geometrical locus of points X having at least two coincident rank-one preimages. 
Such preimages are located on a set CS- 1, the set of coincident rank-one preimages. 
The set CS satisfies the relations T~ l {CS) 3 CS- 1 and T(CS- 1) = CS. A rank- 
q critical set CS q - j. is given by the rank-g image of CS, CS q -i = T q {CS~i), 
CSq s CS. If dim X = p = 1 , CS is a rank-one critical 'point C. When p > 1 the 
results obtained till now essentially concern the class of plane maps (dim X — p = 2) 
[2]. For such maps CS generally becomes a critical curve LC. In exceptional cases 
the critical set may include isolated points. It is the case when the inverse map 
T" 1 has a vanishing denominator [11] [12]. The singularity ’’critical curve” is the 
fundamental tool for studying two-dimensional noninvertible maps. In general LC 
is made up of several branches separating the plane into regions Z, (each of its 

point has i distinct rank-one preimages). The locus CS- 1 becomes a curve LC .i, 

called rank-one curve of merging preimages. When the map T is smooth, LC.. i is a 
set of points for which the Jacobian determinant of T vanishes. When LC is made 
up of only one branch, and separates the plane into two open regions Zq and Z 2 , 
we have the simplest case of noninvertible maps, the (Zq — Z 2 ) one (cf. [2] [3] for 
more complex cases). With respect to the invertible case, the noninvertibility also 
adds new bifurcation types in a parameter space. 

Critical curves permit to define the essential notions of absorbing area (cl 1 ) and 
chaotic area (d) [l]-[3] [6] [9]. Roughly speaking an absorbing area (d r ) is a region 
bounded by arcs of critical curves of finite, or infinite, rank LC n , n = 0,1,2, ...l, 
LC( ) LC, such that the successive images of all points belonging to a neighbor¬ 
hood U(d') of (d 1 ), obtained from a finite number of iterations, enter into ( d ') and 
cannot get away after entering. Except for some bifurcation cases, a chaotic area 
(d) is an invariant absorbing area, containing infinitely many sets of repelling cy¬ 
cles of increasing period, and their corresponding limit sets, the lot having a fractal 
structure. Its boundary dd is made up of LC n arcs. This structure also implies the 
existence of homoclinic and heteroclinic points (sec. 3.3). Note that a chaotic area 
may be periodic of period k, i.e. it is constituted by k nonconnected chaotic areas 
invariant by T k . 
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3.2 Basin boundaries 


Let A be an attracting set (which can be the union of several attractors), U a 
neighborhood of A such as T(U) C U and T n (X) —> A when n —> oo, VX E U. 
The open set D = (J n>0 T~ n (U) is the total- basin of A. When A is the widest 
attracting set of a map T, its basin D (called continent in [1] [2]) is the open set 
containing A such that its closure D is the locus of points of the plane having 
bounded trajectories. Its complementary set, denoted by D' (i.e. D U D' = R 2 ) 
when it is non void, is the basin (called sea in [1] [2]) of an attracting set at infinity 
(on the Poincare’s equator), i.e. the locus of points of the plane having divergent 
trajectories. In such a case the basins D and D' have a common boundary d.D. 

When the map T is invertible, a basin is always simply connected. This is not 
always the case when T is noninvertible, the basin being either simply connected, or 
multiply connected , or nonconnected, or both multiply connected and nonconnected. 
The nonconnected parts of a basin are called islands, and lakes are the holes of a 
multiply connected basin . Consider a Z Q —Z 2 map. Let B be the widest open region 
of a nonconnected basin containing A, such as B fl LC. i ^ 0, and Z 2 the closure of 
Z 2 . If B is multiply connected, let dB e be the external boundary of B, and B* the 
simply connected region bounded by dB e , i.e. B* is obtained by removing the holes 
(lakes) from B. Let C[B) be the complement of B. The following propositions are 
proved in [2]: 

PI. ”(a) B is connected<=^_2Jfl Z 2 is connected <=» T(B HLC-i) = BHLC. 
(b) B is nonconnected <=$■ BC\Z 2 is nonconnected T(BOLC-i) C. BnLC, and 
B is the immediate basin Do of A. Then Do fl Z 2 include r areas, called headlands 
Ag, r = 1,2, ...rn, without any connection with the Do fl Z 2 part containing A. The 
open domains D\ — T _1 (Ao) are rank-one islands (nonconnected with D a ). The 
union of all the increasing rank preimages of A[j is the islands set. 

P2. ’’Suppose BDZ 2 is connected. T~ 1 (B*) C B* •<=>■ B is multiply connected 
<=> .T(B* D LC- 1) D B* n LC. Then each dim 1 largest connected component of 

T(B*nLC .i )\(B*nLC) belongs to a dim 2 close set belonging to C(B)r\Z 2 , called 

a bay denoted Hq, r — 1,2, ...m. The rank-one preimages of H%, H{ = T _1 (. Hq), 
Hq ft LC -1 7^ 0, are the rank-one lakes of the multiply connected basin D. The 
union of the increasing rank preimages of Hq is the lakes set. 

The corresponding qualitative figures can be found in [1] [2]. Maps of (Z\ — Zz 
Zj) type give equivalent propositions changing Z 0 into Z\, Z 2 into Zz, and <=» into 
=>. Then a basin may be also nonconnected (resp. multiply connected) without 
creation of a headland (resp. bay). Let L and L' be the two branches of LC, LC — 
LjIJ. bounding the region Z3. If Bf)L ^ 0 and Bf\IJ = 0 then B is nonconnected. 
If B fl L 7^ 0 and B fl IJ ^ 0 then B is connected. More details are given in [1] [2] 
[13]. In the case of (Z 0 —Z 2 ) and (Z\ — Zz~Z\) maps, global bifurcations related to 
basin transitions ’’simply connected <—> nonconnected, or ’’ simply connected *—> 
multiply connected, or ’’multiply connected <—* nonconnected” are described in the 
above references. Whatever be the map, invertible (with p > 2), or noninvertible 
(with p > 1), a basin boundary dD(A) may be also fractal, i.e. it has a non integer 
dimension, fi.D(/l) containing a strange repeller. 
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3.3 Homoclinic and heteroclinic situations 

Let U be a neighborhood of an unstable fixed point (saddle, node or focus) p*. The 
local (i.e. belonging to U ) unstable set of p* is defined as the locus of points of 
U having a subset of increasing rank preimages which tend toward p*. The global 
unstable set is the locus of all the points having a sequence of preimages which 
converges toward p*. It is invariant and obtained by constructing the images of the 
local unstable set. When the map T is continuous and noninvertible, the unstable 
set W u (p*) of a saddle point p* is connected and self intersections may occur (so 
that it may not be a manifold), which cannot happen for invertible maps. Self 
intersections and loops of ff"(p*j are described in [2] (p. 506-515), [6] (p. 373-374), 
[8] (p. 203-222). The role of critical curves is again essential for understanding the 
formation of self intersections of the unstable set of a saddle, and also the properties 
of invariant closed curves. 

The stable set W s (p*) of a saddle p* is backward invariant T -1 [W s (p*)] = 
W s (p*). It is mapped onto itself by T, T[W s (p*)] C W s (p‘). The stable set 
is invariant if T is invertible, while for a noninvertible map it may be strictly 
mapped onto itself. When T is continuous, W s (p*) self intersections cannot occur. 
Then W*(p*) can be called manifold, being a connected manifold, or the union 
of disjoint connected components which are manifolds. While in invertible maps 
an expanding fixed point (unstable node, or focus) p* has no stable set, when T 
is noninvertible the stable set of p* is given by all the preimages (of any rank) 
of this point: W s (p*) — U n >o T~ n (p*) [2]. So if T is noninvertible W a (p*) may 
be non-connected and made up of infinitely many closed curves, passing through, 
the increasing rank preimages of p*. A point q is said homoclinic to the non¬ 
attracting fixed point p* (or homoclinic point of p*) iff q <E W*(p*) fl W u (p*). 
Heteroclinic. points are obtained when the stable and unstable sets are related to two 
different fixed points. A ’’contact bifurcation” (between a critical set and a stable 
(or unstable) set) may correspond to homoclinic and heteroclinic bifurcations, in 
this framework critical curves are useful for interpreting such problems, and the 
related bifurcations [2], Homoclinic and heteroclinic sets being fractal are source 
of strange repellers. 

4 Plane maps with type A strange repeller 
4-.1 Generalities 

A. strange repeller SR\ of type A is defined as generated by a m- modal dim 1 map 
resulting from the restriction T r of a plane map T to a manifold arc. This means 
that the SRa fractal dimension d/is0<d/<l. The simplest examples are those 
for which one of the two axes is invariant. It is the case of the two following maps 
T: 

x' = ax{\ - lx- y), y' = bxy (4) 

x' — x 2 + y — A, y' = Sx + 'yy + 4 x 2 y (5) 

With the first map the x-axis is invariant, the restriction T r of T to y — 0 
being x' — ajr(l — 2x). The second map with 5 = 0 [14] also gives the x-axis 
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Figure 2. Map(4). a = 4.2, b = 6.16. Basin D(d) of the chaotic area (d). 


invariant, the restriction T r to y = 0 being the Myrberg’s map x 1 = x 2 — A. The 
two maps generate the box-within-a-box fractal bifurcation structure of Fig. 1, 
taking into account a = 1 + \/\ + 4A (cf. sec. 2.4), a > 0. Each of the two 
maps T r generates a strange repeller SRa as soon as a, or A, exceeds the limit of 
flip bifurcation values belonging to the first Myrberg’ spectrum ui i (cf. sec. 2.1). 
This value is A = A u ~ 1.401155189, for x! = x? - A, a = a u =s 3.569945929 for 
x' — ax{ 1 -- 2x). When A > A la and a > oi, infinitely many repelling cycles and 
their limits, constituting the nucleus of SRa , are created on the ®-axis (cf. sec. 
2.3). 

4-2 “Bordering fractals” situations 

Figure 2 represents the basin D(d) of a chaotic area (d) generated by the (Zo . Zf) 

map (4) for a = 4.2. b = 6.16. The a-value of the map T r is such that a > oj = 4 
equivalent to the situation A > AJ defined in sec. 2. So the strange repeller 
SRa is the completely disjointed Julia-Fatou set (i.e. a Cantor set) located inside 
the segment [0, 0~ l ], 0(0;0), O _1 (l/2;0) (cf. sec. 2.1). The fixed point O is 
a saddle (multipliers S'i — 0. S? = a). The basin D{d) is nonconnected. It is 
not fractal (because without self similarity properties), but its boundary dD(d) is 
fractal because dD(d) f! (y — 0) is a Cantor set. A more complete study of another 
quadratic form of this map is given in [15]. The cubic map x' — ax( 1 — 2a: 2 — y). 
y' — 8xy has equivalent properties (see [16] for p = 3.3), but with a strange repeller 
generated by a symmetric cubic bimodal map (Zi -Z3-Z1 type studied, with its 
box-within-a-box fractal structure, p. 415-418 of [6]). We call '"'bordering fractal'' 
such a basin boundary dD{d). 

Consider the following quadratic (Z 0 — Z 2 ) map T (cf. a first study in [17]) 
x‘ = ax + y, y' = b + x 2 


( 6 ) 
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Figure 3. Map(6). a — —0.8, b = —1. Basin (dark grey) of the fixed point Q, and basin (light, 
grey) of the period 3 invariant closed curve I\, i = 1,2,3. 


It is particularly rich in examples leading to fractal situations [2]. The curve 
LC... i where two rank-one preirnages merge is x = (), and the critical curve is the 
line y — b. 

A fold bifurcation occurs when a = —0.8, 6=6/ ~ —0.87001. For b — bj + e. 
s > 0 sufficiently small, only one attractor exists: a stable fixed point Q. Its 
basin boundary d.D(Q) contains cycles not having the period 2*, which indicates 
the existence of a strange repeller SR a on this boundary generated by the dim 1 
noninvertible map restricted to dD(Q) (cf. sec. 2.4). For example let a = -0.8, 
b = -0.867 be the parameters values. The point P (x ~ 2.195, y ~ 3.950) is an 
unstable node (Si = 1.733, S 2 = —2.533), cusp for the basin boundary 8D(Q). 
The p oints P _i, Pl 2 U P£ 2 are respectively the ranks one and two preimages of P, 
and T (PP 2 2 ) = T(PP-y). By application of T 2 , the map T 2 restricted to the arc 
PP -i is unimodal, its extremum being the point LC . : ndD(Q)- According to sec. 
2.4 the presence of two period 20 unstable nodes, i.e. period 10 cycles for T 2 and 
T 2 (so n ot having the period 2*), ensures the existence of a strange repeller SRa on 
the arcs PP_, . PP_ 2 2 . One point of the first k = 20 cycle is x ~ 0.504, y ~ 1.462 
with multipliers Si — 29302, St = 13.34. For the second cycle one has x ca 0.267, 
y ~ 1.667 with multipliers S'i = 28593, S- 2 — —10.57. 

1. he parameter value 6 = 6/ is a fold bifurcation, giving rise for b = bf — e to 
a pair of period three cycles (saddle and stable node) coexisting with the stable 
fixed point Q, inside the previous domain bounded by dD(Q). With decreasing 
values of b the period 3 stable node turns into a stable period 3 focus, the desta¬ 
bilization of which leads to a stable period 3 invariant closed curve Tj, i = 1,2,3 
via a Neimark's bifurcation. Let us denote by A the attracting set of T, made up 
of the union of Q and the stable period 3 set U a (cycle, or F t ). Let D(A) be the 
A basin, dD(A) its boundary, D(A) U 9D(A) being the bounded orbits set. The 
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immediate basin Dq(U 3 ) of U a is nonconnected inside £>(.4), and so the noncon¬ 
nection of the total basin D(U 3 ) C D(A) does not result from the creation of a 
headland. The basin D(Q) of Q is simply connected as the basin D(A). Figure 3 
(a — —0.8, b = -1) shows the two basins D(Q) and D(Tf) when U' s = ’»)• 

The new situation is characterized by the fact that the limit set of the basin D(U 3 ), 
lim n , JO T~ n [Do(U 3 )}, is the strange repeller nucleus inside PP-iUPP 2 _ 2 and its in¬ 
creasing rank preimages located on dD{A), the whole constituting SR a- The basin 
D(Q) has a denditric aspect when D a (U 3 ) is sufficiently large. Such a situation of 
the basins D(Q) and D(U 3 ) is also of ” bordering fractals type. 

5 Fr actal boundary with type C strange repeller 

A strange repeller Site of type C is defined as generated from the destruction of a 
chaotic area (d) (cf. sec. 3.1). This would mean that the SRc fractal dimension 
df is 1 < df < 2. In general they coexist with type-4 ones located on the external 
boundary of a basin. An example is given by the map T (6) with a fixed value 
a = —0.42, the parameter b decreasing from —1.08. For b = —1.08 the map T 
has two attractors: an invariant closed curve F and a stable period three cycle Qi, 
i 1,2,3. their basins boundary being bordering fractal due to a type-4 strange 
repeller SRa, with a nucleus N rA , located on the external boundary of the union 
of the two basins. When b decreases the period three cycle becomes unstable giving 
rise to a stable period three invariant closed curve Fj, which after turns into a 
period three chaotic area (d*), * = 1,2,3 (see Fig. 4 a = -0.42, b = -1.09). For 
b = b c , —1.1182 > b c > —1.1183 a contact bifurcation [2], between the boundary 
d(di) of the chaotic area (df) and the boundary of its immediate basin, destroys the 
chaotic area as an attracting set. When b = b c - s, s > 0 sufficiently small, the (df) 
destabilization gives rise to a strange repeller SRc , the nucleus N[° (i — 1,2,3) of 
which contains infinitely many sequences of unstable cycles with increasing period, 
and their limit sets (cf. Fig. 4b, a — —0.42, b = —1.25). The repeller SRc is the 
union of N[ c and the increasing rank preimages of N[ c . The map T has a unique 
attractor: a stable period seven cycle Fj, j = 1, ...,7, located around the unstable 
focus Q, with a simply connected basin D(Fj). Even if this does not appear by a 
numerical scan of the plane, the basin boundary dD(Fj) is fractal as made up of an 
"external" closed part d e D(Fj) union of four arcs PP-i, PPl 2 - P-1P-2- P-2P-2 
(Fig. 4), and also of SRc located inside the open domain bounded by d e D(Fj), i.e. 
dD(Fj) = d e D(Fj) U SRc- The external boundary d e D(F 3 ) contains the strange 
repeller SRa (0 < d/ < 1) due to the presence of cycles not having the period 2*. 

When b decreases a global bifurcation occurs: the simply connected basin D(Fj) 
turns into a multiply connected one, after the critical curoe LC becomes tangent 
to d c D(Fj), i.e. now d c D(Fj) n LC 4 0- Fakes (holes) of D(Fj) are created 
with a fractal structure (see Fig. 5 and the Fig. 6 enlargements), their limit 
set being constituted by the two strange repellers SRa U SRc- These lakes are 
the increasing rank preimages Hn ' x "™\ i r = 1,2, n = 1,2,3,.., of the bay // 0 . 
Moreover the arborescent sequence of the increasing rank preimages of the SRa 
cycles (belonging to d e D(Fj)) now tends toward SRa U SRc- Continuing the b 
decrease a new bifurcation takes place when the cusp point P 2 2 € T~' 2 (P) has a 




■ 4. Map(6).(a) a = —0.42. 6 = —1.09, chaotic area (di) (light grey), i — 1,2,3, and its 
(black), I' basin (grey), (b) a — -0.42, b = —1.23, (d) has been destroyed. Period-fe 
roles,1 < fc < 19, belonging to the nucleus NJ C (resp. N rA ) of the strange repeller SRq (resp. 
Ra)- SR.c makes fractal the basin boundary. Left column of grey shades gives k. 


5. Map(6).o = —0.42, b = —1.31. Multiply connected basin. The lakes (basin holes) limit 
is the strange repellers union SRc USRa- 


ontact with LC, which after (P 2 -2 6 Z-±) leads to an opening of the lakes in the sea 
domain of divergent orbits), called roadsteads [1] [2]. First D(Fj ) is non connected 
small islands inside the roadsteads, and the boundary d e D(Fj) = dD{Fj) 
fractal, nowhere smooth (in Figs 5-6 d,,D(Fj) is piecewise smooth). With a 
ew b decrease D(Fj) becomes simply connected, dD(Fj) remaining fractal and 






f igure b. Map(bJ. o = —0.42, b = —1.31. Enlargements of t ig.0. 


—0.42. b = —1.6, basin D(d) of the chaotic area (d) . (b) a — —0.42. 


1.65, (<i) is destroyed, chaotic transient before divergen 


the map attractor undergoes a sequence of bifurcations (described in chapter 6 of 
[2]) which leads to a chaotic area (d) (Fig. 7a a — —0.42, b = —1.6). The value 
b — bf ~ —1.63892 gives rise to a contact between the basin boundary dD(d) of 
(d) and the LC segment, belonging to the boundary d(d) of the chaotic area ( d). 
For b < bf the attractor (d) is destroyed, creating a new strange repeller inside the 
domain of divergent orbits. It results from the union of SRa, SRc and the strange 
repeller issued from the destruction of (d). Depending on the initial condition this 
new strange repeller defines a double region of chaotic transient (occupying the 
previous (d) and D(d) areas), before a regular divergence of the orbits (cf. Fig. 7b, 






99 


a = —0.42, b = —1.65). 


6 Class related to the complex dim 1 map and to the derived ones 

A complex one-dimensional map can be written in the form of a two-dimensional 
real one Tz- Then the left parts of the two relations defining Tz verily the Cauchy- 
Riemann conditions. Derived maps from Tz are those obtained by a small pertur¬ 
bation of Tz, the Cauchy-Rieinann conditions being no longer satisfied. This means 
that the strange repeller SR fractal dimension d/isl<d/<2. Such strange re- 
pellers, denoted SRb, will be said of "type B”. For example the quadratic complex 
map Z: z' = z 2 — A (A real parameter) z = x + jy, j 2 = —1. is also the plane 
noninvertible map Tz'. x' = x 2 — y 2 — A, y' = 2 xy. The basin boundary dD of 
the attractor generated by Tz is the well known Julia-Fatou fractal perfect set (E) 
(nowhere smooth) made up of all the repelling cycles, their limit sets, and their 
increasing rank preimages. When A > 2 this fractal set is located on the interval 
—2 < x < 2 of the x-axis with 0 < df < 1 , i.e. all the cycles generated by the 
complex map z' = z 2 — A and their limit sets are real. These cycles are those of the 
Myrberg’s map x' x 2 - A, identified by the symbolism (A :;j) as coming from the 
fractal box-within-a-box bifurcation structure described in sec. 2 , . 

The map T (5) gives rise to regions Zi, i = 0,2,4 (see Figs. 8-10). For <5 = 7 = 0 
the basin boundary structure generated by T is particular and well known in the 
invariant half-plane Il_ = {(x. y) : y < 0} [14]. Indeed there exists a semiconjugacy 
between the map T and the complex quadratic map Z, defined by z' = z 2 — A. Then 
inside II... T is equivalent to the real two-dimensional map Tz- For A = 1 , 7 = <5 = 0 
the map T has two attractors: a fixed point P in the region y > 0, and a period two 
cycles a-i — 1.2 on the x-axis (the one of the Myrberg’s map). Their basins D(P ) 
and D(aj) are light grey and dark grey colored in Fig. 8 a (symmetric with respect 
to x = 0), which shows that the basin boundary dD(cn) nil- is fractal reproducing 
the Julia-Fatou perfect set (nowhere smooth) ( E ) of the map z' = z 2 — 1. The 
boundaries dD{a., ) and dD(P) inside the half-plane y > 0 are smooth. Figure 8 b,c 
shows how dD(di) H EL is perturbed when 7 has a sufficiently small positive value 
(A = 1 , 7 = 0.005, <5 = 0). Due to the formation of the headland A 0 infinitely many 
islands are created, the first one being D\ = T _ 1 (Ao). These islands fractally 
recur. Their limit set is a strange repeller SR issued from the set (E) which has 
lost sequences of Cantor sets Cs[k,j] (cf. sec. 2.3) whose cycles have turned into 
complex ones. Figures 9a,b and 10 (A = 1 , 7 = 0.00005, <5 = 0.009) give another 
behavior of the map (5). In addition to the headland Aq with its related islands, 
the map creates two bays Ho and H' 0 with their related lakes. The islands inside 
Ho and H'o are injected in the lakes (H' {) having ordinates higher than 1.5 does not 
appear in the figure), the nuclei of the related strange repellers being located in 
dD(a-i) n Ho and dD(ai) n H' Q . 

7 Conclusion 

This text gives only a succinct view of the strange repellers (fractal set) role in 
the fractalization of basin boundaries. Section 2.3 has shown this role for a. one- 
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dimensional map. For plane maps T the simplest cases correspond to only one 
repeller denoted SR.a (with a dimension 0 < dj < 1) located on a smooth arc of 
the boundary of a basin D. In this situation SRa is created by a dim 1 multi¬ 
modal map related to the restriction of T to this arc, which gives rise to the fractal 
bifurcation structure described in sec. 2. Strange repellers of type B and C , denoted 
SRb and SRc , have a dimension 1 < df < 2. The paper gives examples of such 
fractal repellers, SRb resulting from a perturbation of a dim 1 map with complex 
variable, SRc resulting from the destruction of a chaotic area. In this last case as 
soon as SRc appears (so out of a smooth arc belonging to the "external" boundary 
of D) it becomes a subset of the complete basin boundary dD, which is fractal 
even if a numerical simulation by plane scanning cannot show this situation. The 
dD fractalization appears numerically after a global bifurcation due to the contact 
of dD with the critical curve LC. Then SRc belongs to the limit set of lakes 
(holes) of the basin if is multiply connected, or islands (nonconnected parts) if it is 
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Figure 10. Map (5), A = 1, 7 = 0.00005, 6 = 0.009. Other enlargement showing the two bays Ho, 


nonconnected. A lot of different situations, not described in this text , occur. They 
differ by the fact that several strange repellers of different types may coexist, by 
the nature of dD, and by the location of LC with respect to dD. Some of these 
situations are shown in [1] [2] [13]. 
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A GENERATIVE CONSTRUCTION AND VISUALIZATION 
OF 3D FRACTAL MEASURES 
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An approach to volume rendering 3D fractal measures is presented. Visualization is 
done with the adaptive level of detail at pixel-size accuracy. Using the IFS representa¬ 
tion we show a generic construction of the measures, which can be thought as a variant 
of Caratheodory’s method when applied to the fractal context. Our construction holds a 
wide range of fractal measures, including the RIFS invariant measures. Then, we intro¬ 
duce the measure instancing technique, which allows one to approximate the measure of 
a set at any accuracy required. The technique enables fractal measures to be ray-traced 
with low memory and without storing a volume of cells in memory resources. Instead, 
we utilize a dynamic hierarchy of balls on the object instancing principles. Rather than 
with semi-lines, the measure is ray-traced with cones so as to speed up computation 
and to prevent aliasing. To illuminate measures, we use a generalization of the volume 
rendering integral which we adapt to the case of measures. 


1. Introduction 

In this paper we investigate the problem of direct volume rendering of measures 
supported by fractals specified by 3D affine IFSs. We present a generic construc¬ 
tion of measures on IFS fractals, which can be considered a fractal variant of the 
general construction by Caratheodory 2 . Our method resembles also the repeated 
subdivision method 3 when applied to the IFS context. Then, we show that the 
class of the IFS and RIFS invariant measures, is just the special case of our gen¬ 
eral recipe. We also define another class of fractal measures which arise from our 
construction and the Perlin noise function 5 . Next, we introduce measure instancing 
which can be regarded as object instancing 6 used in the measure-theoretic context. 
The technique approximates at any accuracy the value of the measure of a given 
subset. In this work we use it to approximate, at pixel-size accuracy, the value of 
our version of the volume rendering integral that we adapt to illuminate measures. 
Measure instancing allows a measure to be rendered volumetrically without any 
volume divided into cells that has to be stored in memory. Instead, the role of a 
volume is played by a dynamical tree of balls, whose single paths are created and 
removed during rendering, on similar principles when ’’solid” IFS attractors are 
ray-traced 6 7 . This allows for the adaptive level of detail at pixel-size accuracy. 
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2. Preliminaries 

2.1. Iterated function systems 

A map w: X —> X on a metric space (X,d) is Lipschitz continuous if there is 
A e [0, oo) such that d(w(x),w(y)) < A d(x,y),Vx,y € X. The smallest A for which 
the inequality holds is called the Lipschitz constant of w, we denote it by X(w). If 
X(w) < 1 then w is called a contractive map (or a contraction ), and X(w) itself is 
termed the contractivity factor of w. If (X, d) is complete then, by the fixed point 
theorem, each contraction possesses exactly one fixed point, i.e. x = w(x), x £ X. 

An iterated function system (IFS) consists of a finite number of contractions 
on a complete metric space (X, d) and it is usually written as {X\ (wi}£Li)- The 
Hutchinson operator associated with the IFS is the map which acts on the space 
Ti{X) of all compact and nonempty subsets of X, and it is defined by W(E) := 
Ui=i Wi(E). One can show that H(X) equipped with the Hausdorff metric is a 
complete metric space, and IF is a contraction on it 1 . Hence, by the fixed point 
theorem, there is a unique nonempty compact set A C X which is invariant under 
W, i.e. A = U£Li Wi(A). The set is called the attractor of the IFS (AT; {wjj-N 

2 . 2 . Measures 

A measure (iona space X is a set function y: 2 X —» [0, oo] which satisfies the 
three following conditions: 1) y(0) = 0; 2) y(A) < y(B) whenever A C B C X; 3) 
MU ~1 Ai) < A‘(A») whenever A* C X. Very often it is convenient to think 

of a measure as a function which specifies a distribution of a mass on space. 

A set S C X is y-measurable if y(E) = y(E 0 5) + y(E \ S), for any E C X. A 
measure y on a metric space ( X , d) is a Borel measure if all Borel subsets of X are 
y- measurable. 

The support of a measure y on a metric space X is defined by spt y := A\(J{F : 
V is open and y(V) = 0}. If y is a Borel measure and X is separable (examples 
are R n and any compact space) then y(X \ spt y) = 0 2 . Thus, in such a case 

y(E) = y{E fl spt y), VE C X (1) 

because spt y is closed and hence Borel, and p(£'\spt y) = 0, for E\ spt y C AT\spt y. 


3. Constructing measures on IFS fractals 

Let A denote the address space 1 on N symbols, that is A consists of semi-infinite 
words a = oi<7 2 ... <r m ..., where <7* £ {1,..., AT}. By cr|n we denote the prefix of 
a of length n, i.e. <r|n = o\o 2 ... er„, n € N, where by convention cr|0 represents 
the empty word. Now, given an IFS (X; {wi}^) with the attractor A, we define a 
function by 


<j){<T\n) 


f w ai o ... o w an if n > 0 
[identity map otherwise 
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for every a E A and n 6 N. 

Let T = {A a | n }, a € A, n € N, be the family of sets specified by the attractor 
subsets A a | n = <p(a\n)(A). Now, let {/V| n }, o € A, n € N, be a collection of 
finite Borel measures on X such that for every n 6 N and a £ A, the following 

N 

two conditions hold: 1) spt/n CT | n C A a \ n , and 2) p, a \ n — /^HnW+i > where 

(er|n)<r„+i = Oi... tJ n o n +\. 

By definition, p = p a \ 0 is a finite Borel measure on X, which is supported by 
a subset of the IFS attractor. Moreover, p can be decomposed into a finite sum of 
Borel measures with supports of diameters not greater than e > 0. The latter is 
due to the fact that IFS attractors are self-tiled sets, which using the notation of 
this paper can be written as 

N N 

Aa\n = <j>(a\n)(A) = <t>(<r\n)( (J w an+1 (A)) = (J <j>{<r\n) o w„ n+1 (A) 



= U ‘KHraK+OM = U A <."\n)<rn+1 


diam(i4 a | n ) < A(<^(cr|n)) diam(A) < JJ A(tc <7i ) diam(A) (2b) 

for any a 6 A and any n 6 N, where A(.) € [0,1). Therefore, the decomposition 
of n can be obtained in a recurrent way be means of object instancing used in the 
measure-theoretic context. Starting with the measure /j, = 2e^=i we replace 
each sum component nonzero measure fi a \ n , for which diam(spt /V|n) > e> with m 
(m < N) nonzero measures /i(<r|n)<r„ +1 , until the diameter of the support of every 
measure in the sum /x = |n fc does not exceed e. Such a decomposition into 

finite sum of measures we will call a e-decomposition of a measure. 

The obvious, yet worth emphasis consequence is that the sum of the total values 
M(£r|n)<T„+i PO of the component ’’sub-measures” p( a \ n )<r n+1 is equal to the total 
value M<r|nP0 °f their ’’parent” measure. Moreover, if AT is a separable metric 
space, then on the basis (1) we get \i a j n (X) = /V| n (spt/x ff |„), because we deal with 
Borel measures. 

Now, we give examples of types of measures on fractals, which arise from our 
general definition. We begin with the well-known measures, namely, the IFS and 
RIFS invariant measures. The standard way of approximating the measures uses the 
chaos game 1 . However, it is usually hard to estimate the quality of such an approxi¬ 
mation in terms of the sufficient number of steps to reach a required approximation 
accuracy. As a result, we never know whether the reason for an unvisited area of 
space is the zero measure of the area or too small number of the iterations per¬ 
formed. Another difficulty appears in the case of 3D measures supported, and is 
due to the inability of incorporating a shading model to the chaos game. 
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As the second example of fractal measures we present a construction which 
employs the Perlin noise function 5 . 


3.1. IFS and Recurrent IFS invariant measures 

A recurrent iterated function system 8 (RIFS) is a generalization of the IFS with 
probabilities in which instead of a vector of probabilities, a probability transition 
matrix appears. Formally, a RIFS is a triple (AT; so that (K\ 

is an IFS on a compact metric space K , and P = \pik] is a N x N row-stochastic 
and irreducible matrix. 

The Markov operator for the RIFS acts on the space P(K N ) of normalized Borel 
measures on the Cartesian product of N copies of K, and is defined by 
N N 

M{v):= (3) 

where v — [v \,..., v^] and v 2 are Borel measures such that J2iLi v i(K) = !• 
One can show that M possesses a unique fixed point p = M(p) on a subspace 
..., v N ] : Ui(K) = 7Tj, i = l,..., IV} o fV{K N ), where 7r — [7Ti,.. -,7 Tjv] € is 
the unique, normalized left-eigenvector of P 8 . Moreover, the support of p is the vec¬ 
tor [A^ 1 ),... ,1^] of compact sets AW c K, such that AM = Ufc ;p)ti >o w»(A( fc )). 
If, for each k G {1,..., AT}, Pik = Pk for every i G { 1,..., N}, then the RIFS reduces 
to the IFS written usually as (K; {pi}^). In such a case n = [pi]f = i- 

The invariant measure p generated by the RIFS is a normalized Borel measure 
on K specified by p as 

p(E) = p[E,...,E\=J^p i (E), E C K. (4) 

On the basis of above, p is supported by the unique compact set 

A* = (JAW, A«=y Wi (A«), (5) 

i=l k:p ki > 0 

that is the attractor of the RIFS 8 . 

Now we show that p can be classified to the class of fractal measures arising 
from our general construction. By definition (4), p equals the sum of N Borel 
measures p ai , o\ = 1,..., IV. Moreover, spt p ax = A^O and p ai ( K) = Tr ai , because 
spt p = [A^, ..., A^M] and p belongs to the subspace of V(K N ) specified by the 
unique eigenvector tv of the matrix P. 

Now, each component measure p ai is equal to the sum of m (m < N) nonzero 
measures p ai o 2 = P<r 2 a 1 Pa 2 ° f° r which p CT2<7l > 0, 02 G {1,..., N}, because 
p is the fixed point of the operator M. Furthermore, p a2 ° w~^(w ai (A ( -' T ^)) > 
p„ 2 (A M 2 )), because w~^(w ai (A^A)} d A^). It follows that spt p ni „ 2 C 
w ai (A (a2) ) and p ni „, 2 (K) = p a2tri n a2 , since spt p„ 2 = A (rJ2 f 
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In turn, each nonzero measure p r , 1 <r 2 can be decomposed into the sum of the 
measures p„ 1 (T 2 ( r 3 = Pa 2 mPa 3 a 2 P <, 3 oiw"' 0 !!)" 1 , where p CT3<r2 > 0 and <73 G {1, ..., N}, 
SO that Spt ll ni <j 2 a 3 C W ai OW ai (A^) and p ai a 2a ,,(K) = Pa 3 rT X Pa 3 a 3 ^<T 3 - 

The above observations lead to the conclusion that each component measure 

P<r\n = ( 11 ^)^ ° W ^"- 1 ° " ' ° ^ 

with spt/i ff |„ C <j>(a\(n - and p a \ n (K) = (nr=i. 1 P<n+i ff ») 7r < r n> °f the 

decomposition of p can be further decomposed into the sum of m (m < N ) measures 

P( ff |n)a„ +1 = ° ° ° • • • ° 

with spt|U (ff | n)o . n+1 C <£((<r|(n - l))<r n )(i4< <7 "+ 1 >) and p {a \ n)an+1 (K) = 

(niLi P^i+io-i) 7r <Tn+i > where p CTn+l0 - n > 0 and a n+ i G {1,..., IV}. 

The last thing is show that the first condition holds, that is spt p a \ n C A a \ n , 
where A a \ n = (f>(a\n)(A) is a subset of the attractor A of the ordinary IFS 
(K\ {u>i}£Li)- By (6) all we have to do is show that <p(cr\(n - l))(A (<Tn) ) C A a \ n . 

Let a be any point of the attractor Ar of a RIFS (K; P). Then one 

can show that there is a word a G A such that lim^oo $(cr|n)(x) = a for any 
x £ K. But limn-.oo <£(cr|n)(;r) is also a point of the attractor A of the IFS 
(. K ; {ruJili) 1 - Hence, Ar is a subset of A. In turn, on the basis of (5) we obtain 
A (i) = w*(Ufc: Pfci >o^ (fc) )> ^ Ufe :pfci >o^ (fc) c U^=i^ (fe) ; hence A^ c Wi(A R ). 
Since Ar c A, we get A^ c Wi(A), and as a result <j>(o-\(n — 1))(A^ <T ")) C A a \ n . 
Thus spt p a \ n C A^n for any a G A and n G N. 


3.2. Perlin-noise measures 

Let (R 3 ; {tUi}^) be an IFS, and let Af: R 3 —► (0,1) be the 3D Perlin noise 
function 5 . For every a G A and n G N + , denote by x<,| n the fixed point of the 
IFS map composition (j>{o\n). Finally, given numbers a G R + and m G {1,..., N}, 
we define a function T on all finite (and nonempty) words over (1,..., N} by 


T((a |nK +1 ) 


f U{a- x Wn)<Tn+1 ) if Af(a • X ( a \ n )* n+1 ) G G a ,„ 
0 otherwise 


where a G A, n G N, cr n+ i = 1,..., N. 

Here, G a \ n is the set of m greatest values taken by Af{.) for N points a-X( (7 | Tl ) CTn+1 , 
<J n +i = 1,..., N. (Thus, 0 < |G CT | n | < m, so G a \ n may be even a singleton—this is 
the case of J\f(.) taking the same value for all N points a ■ X( <x | n ) <rn+1 ) Now, using the 
function T, we define p as a measure that obeys the two conditions of our general 
construction together with the following additional constraint concerning the total 
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values of the component measures 


/V|n(K 3 ) =/i Hn)CTn+1 (M 3 )- 


, + i=i r (( <7 l n )°' Tt + 1 ) 

r((a|n)<7 n+1 ) 


(7) 


Clearly, the constraint does not violate the second condition and it is not hard to 
show that the definition specifies fi in the unique way. 

In this definition the numbers a and m play role of free parameters. The former 
controls the ’’smoothness” of a measure according to the principle the bigger a the 
more perturbed measure. The value of the latter reflects in the ”lacunarity”, i.e. 
the smaller m the more porous measure. 


4. Measure instancing technique 

Let {X; {tUi}^} be an IFS with the attractor A. Let p be a Borel measure re¬ 
sulting from the general construction given in Sec. 3. Then, on the basis of the 
first constraint of the construction and (2), the supports (and their diameters) of 
the component measures /V|„ of the decomposition of fx can be approximated with 
the object instancing for IFS attractors. Starting with a volume enclosing the IFS 
attractor, a collection of volumes is created using recurrently the principle: If the 
diameter of a volume is greater than given e > 0, then the volume is replaced with N 
’’smaller” ones until the diameter of every volume in the collection does not exceed 
e. Moreover, the union of volumes in the collection has to include the attractor on 
every stage of the process of the replacement. Assuming the volume V„\ n to include 
the attractor subset A a \ n , the new volumes V( a \ n ) an+1 , which are substituted for 
V a j n , are determined on the basis of the IFS map compositions </>((ojn)<r n +i), so 
that they enclose the attractor subsets A(„\ n ) an+l , o, l+ i = 1,..., N. 

To approximate the supports of the component measures we use the efficient 
approach to the object instancing for affine IFS attractors which was proposed in 
Ref. 7. The method can be regarded as a variant of the adaptive-cut algorithm 9 
with modifications to avoid the computation of eigenvalues. Basically, the method 
utilizes balls centered at the images of the center of an initial ball under the IFS 
map compositions in a way similar to Ref. 9. However, the radii of the bounding 
balls are determined as r = r 0 \/2i X)*, m ifc> where [m**] is the matrix of the linear 
part of the corresponding map composition and ro is the radius of the initial ball 
that bounds the attractor. 

Now we will show how the above observations can be used in the measure- 
theoretic context so as to approximate the measure of a Borel subset at any accu¬ 
racy required. Let E be a subset of a separable metric space X. Let fi be a Borel 
measure on X, which obeys the two conditions given in Sec. 3. Let B = {B ai \ ni } 
be a family of (closed) balls obtained by means of the described variant of object 
instancing, so that diam(B CT .|„.) < e, where e > 0 is a given approximation er¬ 
ror allowed. Denote by Be the collection of balls | nfc from B so that for every 
q e (0,1,..., n*;} each ball B UIh \ q intersects E, where B Uk | 0 is a ball bounding the 
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attractor. Finally, let ip E be the sum of all the component measures p Uk \ nk whose 
supports are approximated by the balls from Be- Clearly, ^ as a finite sum of 
finite Borel measures on X is a finite Borel measure on X. 

Proposition. ij) e {X) does not increase as e > 0 decreases, and lim ipe(X) = //(F). 
Hence, if p is supported by a subset of R 2 , then the measure can be visualized 
at pixel-size accuracy by computing the //-measures of pixels and interpreting the 
obtained values as brightness or color 9 . 


5. Volume rendering 3D measures 

The case of 3D measures requires a more sophisticated approach to rendering. It 
seems that the method, which is based on volume ray-tracing of gaseous models, is 
a good choice for this purpose. 

5.1. Brightness equation for measures 

The basis for our illumination model for measures is the volume rendering integral 10 
for ray-tracing volume densities. Given a density field p\ D —► [0, oo], D C R 3 , the 
amount of light /( o,3) coming to the eye o from direction 3, is computed as 

I(o,3)= J e { - Tl L n ^^C(r(t))p(r(t))dt. (8) 

Here, r(t) = o + tw, t m i„ = max(0,d m j n ) and t max = min(d g iobai, dmax), so that 
r(d m i n ) and r(d max ) respectively are the nearest and the farthest point of the inter¬ 
section of the ray r with D, and r(d g i 0 b a i) is the nearest intersection of r with the 
rest of the scene. The exp represents the attenuation of light caused by the field, 
and C(r(t)) is the contribution of light sources to the brightness of a point. 

Unfortunately, there are two problems with the use of (8) as a shading model for 
measures. The first one is due to that the equation operates in terms of density. The 
natural definition of the density p of a measure p on R n specifies p to be the Radon- 
Nikodym derivative of p with respect to n-dimensional Lebesgue measure, which 
is usually written dp = pdx, x € X c R". However, using the Radon-Nikodym 
theorem (Refs. 4, 11), one can show that measures on fractals have usually no 
densities well-defined, at least in the above Lebesgue sense. On the other hand, if p 
has a density p with respect to a measure p (in our case the Lebesgue measure), then 
for every nonnegative measurable function g on X the equality / g dp = f gp dip 
holds 11 . This suggests the simple remedy: replace the density factors dp(r(t)) and 
dp{v(u)) in (8) with the measure ones p(dr(t)) and p(dr(u)) respectively to obtain 
a generalized version of the volume rendering integral. 

The second problem is that the integrations are over one-dimensional intervals, 
whereas the density (and the measure) is 3D. Hence, if it was possible to solve 
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Figure 1. Results of volume cone tracing RIFS invariant measures supported by subsets of a 
cube. 

the integral in an accurate way, its value would almost always equal 0, because 
3-dimensional measure of an interval is usually zero. Consequently, by (8), a den¬ 
sity field (and a measure) should not be visible for the observer, at least formally. 
Therefore, we integrate over 3-dimensional beams of a nonzero volume rather than 
usual linear rays. 

Summarizing, we get the following volume rendering integral for measures. Let 
H be a finite measure supported by a compact subset DcR 3 . Denote by £1 the 
projection of a given pixel onto the unit sphere that is centered at the eye o serving 
as the center of projection. The amount of light reaching the eye through the pixel 
is described by the Lebesgue integral 



/ 



> C(r(t,u;))M(dr(t,(3)). (9) 


n t u ,tn(3) 


Here, r(f,w) = o + tuj, and dv{t,3) is a g -measurable element of the solid angle dui 
and extent dt with respect to the direction Q a . The C(r(t,w)) factor supplies the 
light reaching the elementary volume dr(t,w) as illuminated by light sources. 

5.2. Tracing measure with cones 

The visualization of a 3D measure relies on evaluating (9) for each pixel of the 
screen. Assuming rectangular pixels, the area of integration in (9) is a pyramid 
specified by a pixel and the apex at the eye. Therefore, the integration can be 
regarded as calculating a measure of the pyramid, so that the ^-measure of each 
elementary volume dr(t, C3) is weighted by the value of a function /(t, w) representing 
the attenuation and illumination components. In turn, taking into account the main 


“Points on the unit sphere can be identified with directions. Consequently, dw can be considered 
as an elementary bundle of directions about a direction (3, where the size of the bundle is measured 
in steradians. 
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Figure 2. Examples of cone-tracing of Perlin measures supported by subsets of affine and over¬ 
lapping ’’cloudy” IFS attractor. 


external integration over fi, the integral of the attenuation factor is the p-measure 
of an elementary bundle of intervals ranging from the eye to a given element dr(u,uj) 
within the pyramid. 

Thus, (9) can be approximated with measure instancing as the ” total value” 
of the measure ip e from Sec. 4. Assuming the set E to be the pyramidal area 
of integration and identifying the balls from the family B E are elementary volume 
elements, we may compute (9) at accuracy induced by the size of a pixel. The direct 
application of this idea involves pyramidal rays to look for intersections with balls 
determined with the object instancing used in the ray-tracing context 6-7 . However, 
in order to increase the efficiency, rather than pyramids, we utilize cones in the spirit 
of cone-tracing 12 . 

Let e > 0 be an approximation error. In particular, £ may be set that the 
projection of every ball from B on the screen does not exceed the width of a pixel. 
The first step to approximate (9) is to determine family B E = of N{e) 

balls R wt |„ fc , diam(B^ | nt .) < £, intersected by a cone shot through a given pixel. 
The family specifies the component measures of the sum ?/•>? whose value 

i/> e (M 3 ) = (® 3 ) approximates the p-measure of the cone. In practice, 

we utilize a list structure, and to compute the balls and values we use 

measure instancing. We store the results as couples (B WI |, U , p Wfc | nt (lR 3 )) in the list. 
Next, we sort the list in the increasing order w.r.t the distances of the centers to 
the eye. Then, proceeding front-to-back, we approximate (9) on the basis of iV(e) 
sorted couples (£?,-, p,(K 3 )) by 

AT( £ ) 

/(o,H) « e ( - T ^i=‘'"' (Rj)) C'(B i )f*«(R 3 )- (10) 

Here, the term C\{Bi) is the light received by the ith ball from all light sources. 

6. Results 

Six images of fractal measures are reproduced here to give a flavor of the variety 
of measures arising from the generic construction proposed in this paper. Besides 
brightness, we have also computed the average density 4 in balls from B using the 
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formula p(B) = £ • dl ^B )* » so 35 to reveal the measure’s local property. Values 
l-i(B) have been approximated with measure instancing in parallel with brightness. 
As it is impossible to represent all the densities along the ray with one color, we 
have applied the approach used in Ref. 13 and visualize only one value of the 
discrete density function over the ray—in this work we chose the maximum. To 
encode the information about density together with the brightness we engage HSV 
color space and determine the color of a pixel mapping the brightness to the Value 
component and the maximal density to the Hue component (reversed here so that 
’hot’ colors indicate high values). Additionally, we utilize the Saturation component 
to represent the distance between the eye and the maximal density according to the 
principle the closer to the eye, the more saturated. (We also used symbolically green 
to mark the attractor subsets of the measure close or equal zero.) 

The first three, Fig. 1, seem to be good 3D equivalents of 2D fractal measures 
whose images serve as a tutorial examples in Ref. 1. They depict examples of RIFS 
invariant measures supported by a subset of a cube encoded with 8 similarities. 
Finally, Fig. 2 exemplifies Perlin noise measures carried by a cloudy support speci¬ 
fied with 8 affine maps and overlapping IFS. Each of the images was cone-traced at 
1200 x 900 screen resolution and pixel-size accuracy on AMD Athlon 64 Processor 
3000+ 2.01 GHz. 
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COMPLEXITY IN NATURE AND SOCIETY 


Complexity Management in the Age of Globalization 
KLAUS MAINZER 


The t heory o f n onlinear c omplex sy stems h as b ecome a proven p roblem-solving a pproach i n the 
natural sciences from cosmic and quantum systems to cellular organisms and the brain. Even in 
modem engineering science self-organizing systems are developed to manage complex networks and 
processes. It is now recognized that many of our ecological, social, economic, and political problems 
are also of a global, complex, and nonlinear nature. What are the laws of sociodynamics? Is there a 
socio-engineering of nonlinear problem solving? What can we learn from nonlinear dynamics for 
complexity management in social, economic, financial and political systems? Is self-organization an 
acceptable strategy to handle the challenges of complexity in firms, institutions and other 
organizations? It is a main thesis of the talk that nature and society are basically governed by 
nonlinear and complex information dynamics. How computational is sociodynamics? What can we 
hope for social, economic and political problem solving in the age of globalization? 


1. From Linear to Nonlinear Dynamics 


A dynamical system is characterized by its elements and the time-depending development 
of their states. In the simple case of a falling stone, a physicist like Galileo only considers 
the acceleration of a single element. In a planetary system, the states of planets are 
determined y their position and momentum. The states can also refer to moving 
molecules in a gas, the excitation of neurons in a neural net, nutrition of populations in an 
ecological sy stem, o r p roducts i n a market sy stem. T he dynamics o f a s ystem, i. e. t he 
change of system states depending on time, is mathematically described by differential 
equations. For deterministic processes (e.g., motions in a planetary system), each future 
state is uniquely determined by the present state. A conservative (Hamiltonian) system, 
e.g. an ideal pendulum, is determined by the reversibility of time direction and 
conservation of energy. Actually, conservative systems are closed and have no energetic 
dissipation with their environment. Thus, conservative systems in the strict sense only 
exist as approximations like, e.g., a Thermos bottle. In our everyday world, we mainly 
observe dissipative systems with a distinct time direction. Dissipative systems, e.g., a real 
pendulum with friction, are irreversible. 

In classical physics, the dynamics of a system is considered as a continuous 
process. In a famous quotation, Leibniz assumed that nature does not jump (natura non 
facit saltus). But, continuity is only a mathematical idealization. Actually, a scientist has 
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single observations or measurements at discrete-time points which are chosen equidistant 
or defined by other measurement devices. In discrete processes, there are finite 
differences between the measured states and no infinitely small differences between the 
measured states and no infinitely small differences (differentials) which are assumed in a 
continuous process. Thus, discrete processes are mathematically described by difference 
equations. 

Random events (e.g., Brownian motion in a fluid, mutation in evolution, 
innovations in economy) are represented by additional fluctuation terms. Classical 
stochastic processes, e.g. the billions of unknown molecular states in a fluid, are defined 
by time-depending differential equations with distribution functions of probabilistic 
states. In quantum systems of elementary particles, the dynamics of quantum states is 
defined by Schrodinger’s equation with observables (e.g., position and momentum of a 
particle) depending on Heisenberg’s principle of uncertainty which allows only 
probabilistic forecasts of future states. 

Historically, during the centuries of classical physics, the universe was 
considered as a deterministic and conservative system. The astronomer and 
mathematician P.S. Laplace (1814), e.g., assumed the total computability and 
predictability of nature if all natural laws and initial states of celestial bodies are well 
known. The Laplacean spirit expressed the belief of philosophers in determinism and 
computability of the world during the 18 th and 19 th century. 

Laplace was right about linear and conservative dynamical systems. A simple 
example is a so-called harmonic oscillator like a mass attached to a spring oscillating 
regularly without friction. This example is considered in more detail in order to introduce 
the basic notions of time series, phase space and trajectory. Only with these instruments it 
is possible to recognize and to understand the structure and development of dynamical 
systems. In general, a linear relation means that the rate of change in a system is 
proportional to its cause: Small changes cause small effects while large changes cause 
large e ffect. I n t he e xample of a h armonic o scillator, a sm all c ompression o f a s pring 
causes a small oscillation of the position of a mass, while a large compression causes a 
large oscillation according to Hooke’s law. 

Changes of a dynamical system can be modeled in one dimension by changing 
values of a time-depending quantity along the time axis ( time series). For example, the 
position x(t) of a mass attached to a spring is oscillating in regular cycles along the time 
axis t. x(t) is the solution of a linear equation, according to Hooke’s law. Mathematically, 
linear equations are completely computable. This is the deeper reason for Laplace’s 
philosophical assumption to be right for linear and conservative systems. 

In systems theory, the complete information about a dynamical system at a 
certain time is determined by its state at that time. In the example of an harmonic 
oscillator, the state of the system is defined by the position x{t) and the velocity v(t) of the 
oscillating mass at time t. Thus, the state of the system is completely determined by a pair 
of two quantities which can be geometrically represented by a point in a 2-dimensional 
phase space with a coordinate of position and a coordinate of velocity. The dynamics of a 
system means the time-depending development of its states. Thus, the dynamics of a 
system is illustrated by an orbit of points ( trajectory ) in a phase space corresponding to 
the time-depending development of its states. In the case of an harmonic oscillator, the 
trajectories are closed ellipses around a point of stability, corresponding to the periodic 
cycles of time series, oscillating along the time axis. Obviously the regular behavior of a 
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linear and conservative system corresponds to a regular and stable pattern of orbits. So, 
the past, presence, and future of the system is completely known. 

In general, the state of a system is determined by more than two quantities. 
Then, a higher dimensional phase space is needed to study the dynamics of a system. 
From a methodological point of view, time series and phase spaces are important 
instruments to study systems dynamics. The state space of a system contains the complete 
information o f i ts p ast, p resent a nd future b ehavior. T he dynamics of real systems in 
nature and society is, of course, more complex, depending on more quantities with 
patterns of behavior which are not as regular as in the simple case of an harmonic 
oscillator. It is a main insight of modem systems theory that the behavior of a dynamic 
system can only be recognized if the corresponding state space can be reconstructed. 

At the end of the 19 th century, H. Poincare (1892) discovered that celestial 
mechanics is not a completely computable clockwork, even if it is considered as a 
deterministic and conservative system. The mutual gravitational interactions of more than 
two celestial bodies (‘Many-bodies-problem’) correspond to nonlinear and non- 
integrable equations with instabilities and irregularities. According to the Laplacean 
view, similar causes effectively determine similar effects. Thus, in the phase space, 
trajectories that start close to each other also remain close to each other during time 
evolution. Dynamical systems with deterministic chaos, exhibit an exponential 
dependence on initial conditions for bounded orbits: the separation of trajectories with 
close initial states increases exponentially. 

Thus, tiny deviations of initial data lead to exponentially increasing 
computational efforts for future data limiting long-term predictions, although the 
dynamics is in principle uniquely determined. This is known as the ‘butterfly effect’: 
initial, small and local causes soon lead to unpredictable, large and global effects (see 
Fig. 4). According to the famous KAM-Theorem of A.N. Kolmogorov (1954), V.I. 
Arnold (1963), and J. K. Moser (1967), trajectories in the phase space of classical 
mechanics are neither completely regular, nor completely irregular, but depend 
sensitively on the chosen initial conditions. 

Dynamical systems can be classified on the basis of the effects of the dynamics 
on a region of the phase space. A conservative system is defined by the fact that, during 
time evolution, the volume of a region remains constant, although its shape may be 
transformed. In a dissipative system, dynamics causes a volume contraction. 

An attractor is a region of a phase space into which all trajectories departing 
from an adjacent region, the so-called basin of attraction, tend to converge. There are 
different kinds of attractors. The simpliest class of attractors are the fixed points. In this 
case, all trajectories of adjacent regions converge to a point. An example is a dissipative 
harmonic oscillator with friction: the oscillating system is gradually slowed down by 
frictional forces and finally come to a rest in an equilibrium point. 

Conservative harmonic oscillators without friction belong to the second class of 
attractors with limit cycles, which can be classified as being periodic or quasi-periodic. A 
periodic orbit is a closed trajectory into which all trajectories departing from an adjacent 
region converge. For a simple dynamical system with only two degrees of freedom and 
continuous time, the only possible attractors are fixed points or periodic limi t cycles. An 
example is a Van der Pol oscillator modelling a simple vacuum-tube oscillator circuit. 

In continuous systems with a phase space of dimension n > 2, more complex 
attractors are possible. Dynamical systems with quasi-periodic limit cycles show a time 
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evolution which can be decomposed into different periodic parts without a unique 
periodic regime. The corresponding time series consist of periodic parts of oscillation 
without a common structure. Nevertheless, closely starting trajectories remain close to 
each other during time evolution. The third class contains dynamical systems with 
chaotic attractors which are non-periodic, with an exponential dependence on initial 
conditions for bounded o rbits. A famous example is the chaotic attractor of a Lorenz 
system simulating the chaotic development of weather caused by local events, which 
cannot be forecast in the long run ( butterfly effect). 

From a methodological point of view, we have started by seeing the kind of 
mathematical equations of dynamical systems required to derive their patterns of 
behaviour; the latter have been characterized by time series and attractors in phase 
spaces, such as fixed points, limit cycles, and chaos. This top-down approach is typically 
theoretical: we use our understanding of real systems to write dynamical equations. In 
empirical practice, however, we must take the opposite bottom-up approach and start 
with finite sequences of measurements, i.e. finite time series, in order to find appropriate 
equations of mathematical models with predictions that can be compared with 
measurements made in the field of application. 

Measurements are often contaminated by unwanted noise which must be 
separated from the signals of specific interest. Further on, in order to forecast the 
behaviour of a sy stem, the development of its future states must be reconstructed in a 
corresponding phase space from a finite sequence of measurements. Thus, time-series 
analysis is an immense challenge in different fields of research from, e.g., climatic data 
in meteorology, ECG-signals in cardiology, and EEG-data in brain research to economic 
data of economics and finance. 

In principle, we distinguish linear and nonlinear stochastic models of time- 
series analysis. Being linear, their properties can be fully and rigorously derived from 
their model equations. In order to generate aperiodic time series data, such models 
require stochastic inputs. Auto regressive (AR) models with Gaussian distributed white 
noise represent the time discretized motion of the superposition of damped harmonic 
oscillators driven by noise under some stability conditions. Thus, spectral analysis is the 
most suitable analysis tool. The sunspot number time series of solar activity with its 
pronounced 11-year period can be captured by an AR-model. AR-models are suitable for 
data sets that have a few pronounced peaks in their power spectrum. If the the observed 
power spectrum instead is broad band, the moving average (MA) model can be a more 
appropriate tool. A combination of both, the ARMA-models, describes many noise- 
dominated signals. A different class of sources for aperiodic time-series data arises from 
chaotic dynamical systems. In this case, aperiodicity comes from intrinstic instabilities 
without random inputs. Nonlinearity destroys the superposition principle, such that a 
Fourier decomposition of the signal is not useful. If one assumes that a given 
experimental observable represents the deterministic dynamics in some non-observed and 
even unknown phase space, the concept of phase space reconstruction by embedding is 
needed. 

In practice, only a time series of a single (one-dimensional) measured variable is 
often given, although the real system is multidimensional. The aim of forecasting is to 
predict the future evolution of this variable. According toTakens’ theorem (1981), in 
nonlinear, deterministic and chaotic systems, it is possible to determine the structure of 
the multidimensional dynamic system from the measurement of a single dynamical 
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variable. T akens’ method r esults in the construction of a multidimensional embedding 
phase space for measured data with a certain time delay in which the dynamics of 
attractors is similar to the orbits in the phase space of the chaotic system. 

The disadvantage of Takens’ theorem is that it does not detect and prove the 
existence of a chaotic attractor. It only provides features of an attractor from measured 
data, if the existence of the attractor is already guaranteed (Grassberger 1983). The 
dimension of an attractor can be determined by a correlation integral defining the 
different frequency with which a region in an attractor is visited by the orbits. Thus, the 
correlation integral also provide a method to study the degrees of periodicity and 
aperiodicity of orbits and measured time series. 

The Lyapunov Spectrum shows us the dependence of dynamics from initial data. 
The Lyapunov exponents measure the averaged exponential rates of divergence or 
convergence of neighbouring orbits in phase space. If the largest Lyapunov exponent is 
positive, the attractor is chaotic, and the initial small difference between two trajectories 
will diverge exponentially. If the largest exponent is zero and the rest is negative, the 
attractor is a periodic limit cycle. If there is more than one exponent equal to zero, the rest 
being negative, the behaviour is quasi-periodic. If the exponents are all negative, the 
attractor is a fixed point. In general, for dissipative systems, the sum of Lyapunov 
exponents is negative, in spite of the fact that some exponents could be positive. 


2. Complexity and Nonlinear Dynamics of Evolution and Brains 


Structures in nature can be explained by the dynamics and attractors of complex systems. 
They result from collective patterns of interacting elements that cannot be reduced to the 
features of single elements in a complex system. Nonlinear interactions in multi- 
component (‘complex’) systems often have synergetic effects which can neither be traced 
back to single causes nor be forecast in the long run. The mathematical formalism of 
complex dynamical systems is taken from statistical physics. But, in general, the theory 
of complex dynamical systems deals with profound and striking analogies which have 
been discovered in the self-organized behaviour of quite different systems in physics, 
chemistry, and biology. These multi-component systems consist of many units like 
elementary particles, atoms, cells or organisms. The elementary units, e.g., their position 
and momentum vectors, and their local interactions constitute the microscopic level of 
description, for instance, the interacting molecules of a liquid or gas. The global state of 
the complex systems results from the collective configurations of the local multi- 
component states. At the macroscopic level, there are few collective (‘global’) quantities 
like, for instance, pressure, density, temperature, and entropy characterizing observable 
collective patterns or figures of the units. 

If the external conditions of a system are changed by varying certain control 
parameters (e.g., temperature), the system may undergo a change in its macroscopic 
global states at some threshold value. For instance, water as a complex system of water 
molecules changes spontaneously from a liquid to a frozen state at the critical value of 
temperature with zero Celsius. In physics, those transformations of collective states are 
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called phase transitions. Obviously, they describe a change o f s elf-organized b ehavior 
between the interacting elements of a complex system. 

According to L. D . Landau ( 1959), the suitable macro variables characterizing 
this change of global order are denoted as ‘order parameters ’. In statistical mechanics the 
order transition of complex systems like fluids, gases, etc. is modeled by differential 
equations of the global state. A paradigmatic example is a ferromagnet consisting of 
many elementary atomic magnets (‘dipoles’). The two possible local states of a dipole are 
represented by upwards and downwards pointing arrows. If the temperature (' control 
parameter’) is annealed to the thermal equilibrium which is in this case the Curie point, 
then the average distribution of upwards and downwards pointing dipoles {‘order 
parameter ’) is spontaneously aligned in one regular direction. This regular pattern 
corresponds to the macroscopic state of magnetization. Obviously, the emergence of 
magnetization is a self-organized behaviour of atoms which is modelled by a phase 
transition of a certain order parameter, the average distribution of upwards and 
downwards pointing dipoles. 

Landau’s scheme of phase transitions cannot be generalized to all cases of phase 
transitions. A main reason for its failure results from an inadequate treatment of 
fluctuations, which are typical for many multi-component systems. Nevertheless, 
Landau’s scheme can be used as a heuristic device to deal with several non-equilibrium 
transitions. In this case, a complex system is driven away from equilibrium by increasing 
energy (not decreasing energy as in die case of equilibrium transitions like freezing water 
or magnetizing ferromagnets). The phase transitions of nonlinear dissipative complex 
systems far from thermal equilibrium can be modelled by several mathematical methods. 

As an example, consider a solid-state laser which consists of a set of laser-active 
atoms embedded in a solid-state configuration. The laser end faces act as mirrors serving 
two purposes: they select light modes in axial direction and with discrete frequencies. If 
the laser atoms are excited only weakly by external sources (‘ control parameters'), the 
laser acts as an ordinary lamp. The atoms independently of each other emit wave-tracks 
with random phases. The atoms, visualized as oscillating dipoles, are oscillating 
completely at random. If the level of excitement is further increased, the atomic dipoles 
spontaneously oscillate in phase, although they are excited completely at random. 
Obviously, the atoms show a self-organized behaviour of great regularity. The 
extraordinary coherence of laser light results from the collective cooperation of the 
atomic dipoles. 

The laser shows features of phase transitions. Order parameters describe mode 
amplitudes of the light field becoming unstable at a critical value of pumping. These 
slowly varying amplitudes now ‘‘slave’’, as H. Haken claimed, the atomic system during 
a critical transition. The atoms have to “obey” the orders of order parameters. This 
mathematical scheme has a very comfortable consequence: it is not necessary (and not 
possible) to compute all microstates of atoms in a complex system, find the few 
macroscopic order parameters, and you understand the dynamics of a complex system. 

Actually, the corresponding equations describe a competition of several order 
parameters among each other. The atoms will then obey that order parameter that wins 
the competition. A typical example is a Benard experiment analyzing the emergence of 
convection rolls in a fluid layer at a critical value of a control parameter (temperature). 
Examples can also be observed in the layers of the atmosphere. In this case, the order 
parameters correspond to the two possible rolling directions “left” or “right” of the 
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convection rolls. During the phase transition of increasing temperature it cannot be 
forecast which of the two possible order parameters will win the competition, because it 
depends on tiny initial fluctuations on the molecular level. Thus, this phase transition 
corresponds to a spontaneous symmetry breaking of two possible orders. Fluctuations are 
the driving forces of the system’s evolution. 

In a more qualitative way we may say that old structures become unstable, 
broken down by changing control parameters, and new structures and attractors are 
achieved. If, for example, the fluid of a stream is driven further and further away from 
thermal equilibrium, e.g., by increasing fluid velocity (control parameter), then fluid 
patterns of increasing complexity emerge from vortices of fixed points, periodic and 
quasi-periodic oscillations to chaotic turbulence. 

In a more mathematical way, stochastic nonlinear differential equations (e.g., 
Fokker-Planck-equations, Master equation) are employed to model the dynamics of 
complex systems. The dominating order parameters are founded by the adiabatic 
elimination of fast relaxing variables of these equations. The reason is that the relaxation 
time of unstable modes (order parameters) is very long compared to the fast relaxing 
variables of stable ones, which can therefore be neglected. Thus, this concept of self¬ 
organization can be illustrated by the quasi-biological slogan: long-living systems 
dominate short-living systems. 

Dynamical systems and their phase transitions deliver a successful formalism to 
model the emergence of order in nature. But these methods are not reduced to special 
laws of physics, although their mathematical principles were first discovered and 
successfully applied in physics. There is no physicalism, but an interdisciplinary 
methodology to explain the increasing complexity and differentiation of forms by phase 
transitions. The question is how to select, interpret and quantify the appropriate variables 
of dynamical models. Let us consider a few examples. 

Thermodynamic self-organization is not sufficient to explain the emergence of 
life. As nonlinear mechanism of genetics we use the autocatalytic process of genetic self¬ 
replication. The evolution of new species by mutation and selection can be modelled by 
nonlinear stochastic equations of second-order nonequilibrium phase transitions. 
Mutations are mathematized as ‘fluctuating forces’ and selections as ‘driving forces’. 
Fitness degrees are the order parameters dominating the phase transitions to new species. 
During e volution a sensible network o f e quilibria b etween p opulations o f a nimals a nd 
plants has developed. The nonlinear Lotka-Volterra equations model the ecological 
equilibrium between prey and predator populations which can be represented by 
oscillating time series of population growth or limit cycles around points of stability. 
Open dissipative systems of ecology may become unstable by local perturbations, e.g., 
pollution of the atmosphere, leading to global chaos of the atmosphere in the sense of the 
butterfly effect. 

In brain research, brain is considered a complex dynamical system of firing and 
non-firing neurons, self-organizing in macroscopic patterns of cell assemblies by 
neurochemical interactions. Their dynamical attractors are correlated with states of 
perception, motion, emotion, thoughts, or even consciousness. There is no ‘mother 
neuron’ which can feel, think or at least coordinate the appropriate neurons. The famous 
binding problem of pixels and features in a perception is explained by clusters of 
synchronously firing neurons dominated by learnt attractors of brain dynamics. The brain 
is also a self-monitoring and self-mapping system of all bodily, cognitive, and emotional 
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states leading to self-awareness and self-consciousness which can be interpreted as 
dominating order parameters. Thus, even human subjectivity, the traditional 
philosophical problem of ‘qualia’, can be explained by nonlinear dynamics of complex 
systems. H uman i ntentions a nd p references c orrespond t o a ttractors o f b rain d ynamics 
influencing human acting and behaviour. 

In general, complex dynamical systems can be characterized by a specific time 
scaling. I. Prigogine draws a distinction between the reversible ‘ exterior ’ time or its 
‘age ’. While the ‘exterior’ time is the usual real time parameter t that is registered by a 
clock, the ‘interior’ time is defined as an operator that takes into account the irreversible 
changes in the system’s states. As a real parameter, the exterior time appears merely as an 
index in a unique set of trajectories (in classical physics) or in a wave equation (in 
quantum mechanics). As an operator, the interior time permits statements about the 
temporal development of a complex collection of trajectories or distribution functions 
that serve mathematically as the eigenfunctions of the time operator. The connection with 
external time rests on the eigenvalues of the time operator being real length of time as 
registered by a normal clock. The distributions represent the different interior ‘ages’ of a 
complex system. For example, the different organs of a complex system like the human 
organism wear o ut a t d ifferent st ates. T he t ime o perator a ssigns a ‘mean a ge ’ t o e ach 
state of the system, which increases at the same rate as the exterior clock time. In this 
sense, each dynamical system has its interior time. A well-known example is the 
subjectively experienced time of consciousness. The subjectively experienced duration of 
a time depends on the frequency and distribution of occurrences which are registered by 
the brain in the corresponding period of clock time. In periods of business, time seems to 
speed up. But during periods without action, time runs slowly. 


3. Complexity and Nonlinear Dynamics of Economies and Finance 


The self-organization of complex systems can also be observed in social groups. If a 
group of workers is directed by another worker, the so-called foreman, then we get an 
organized behaviour to produce some product which is by no means self-organized. Self¬ 
organization means that there are no external orders of a foreman, but the workers work 
together by some kind of mutual understanding, each one doing his job according to a 
collective concept dominating their behaviour. Another application of social dynamics is 
the behaviour of car drivers. In automobile traffic systems, a phase transition from non¬ 
jamming to jamming phases depends on the averaged car density as control parameter. 
The spontaneous emergence of chaotic patterns of traffic is a famous self-organizing 
effect of nonlinear interactions which can often not be reduced to single causes. At a 
critical value, fluctuations with fractal or self-similar features can be observed. The term 
self-similarity states that the time series of measured traffic flow looks the same on 
different time scales, at least from a qualitative point of view with small statistical 
deviations. This phenomenon is also called fractality. In the theory of complex systems, 
self-similarity is a (not sufficient) hint on chaotic dynamics. These signals can be used by 
guide systems of traffic. 

In a political community, collective trends or majorities of opinions can be 
considered as order parameters which are produced by mutual discussions and 
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interaction of the people in a more or less ‘heated’ situation. They can even be initiated 
by some few people in a critical and unstable (‘revolutionary’) situation of the whole 
community. There may be a competition of order concepts during heavy fluctuations. 
The essential point is that the winning concept of order will dominate the collective 
behaviour of the people. Thus, there is a kind of feedback: the collective order of a 
complex system is generated by the interactions of its elements (‘self organization’). 
After thermodynamic, genetic, and neural self-organization we also distinguish social 
and economic self-organization. On the other hand, the behaviour of the elements is 
dominated by the collective order. People have their individual will to influence 
collective trends of society. Nevertheless, they are also driven by attractors of collective 
behaviour. 

But, in contrast to physical, chemical, and biological systems, no equations of 
motion on the microlevel are available for social systems. People are not atoms or 
molecules, but human beings with intentions, motivations, and emotions. In principle, 
their individual behaviour and decision-making could be explained by their brain 
dynamics. Cognitive and emotional dynamics are determined by order parameters 
characterizing individual thoughts, decisions, and motivations. But this is only a 
theoretical option, because the corresponding neural equations are not yet known. 
Furthermore, they would be too complex to solve them and predict the future behaviour 
of people. 

Therefore an alternative approach is suggested which gets along without 
microscopic equations, but nevertheless takes into account the decisions and actions of 
individuals with probabilistic methods in order to derive the macrodynamics ofs ocial 
systems. The modelling design consists of three steps: In the first step appropriate 
variables of social systems must be introduced to describe the states and attitudes of 
individuals. The second step defines the change of behaviour by probabilistic phase 
transitions of individual states. The third step derives equations for the global dynamics 
of the system by stochastic methods. 

In a society we can distinguish several sectors and sub-sectors that are denoted 
by variables. There are variables for material states, extensive and intensive personal 
states. The socioconfiguration of a social system is characterized by these material and 
personal macrovariables. They are measured by usual methods of demoscopy, sociology, 
or economics. Like in thermodynamics, there are intensive economic variables that are 
independent of the size of a system. Examples are prices, productivity, and the density of 
commodities. Extensive variables are proportional to the size of a system and concern, 
for example, the extent of production and investment, or the size and number of 
buildings. Collective material variables are measurable. Their values are influenced by 
the individual activities of agents, which are often not directly measurable. The social and 
political climate of a firm is connected to socio-psychological processes, which are 
influenced by the attitudes, opinions, or actions of individuals and their subgroups. Thus, 
in order to introduce the socioconfiguration of collective personal variables, we must 
consider the states of individuals, expressed by their attitudes, opinions, or actions. 
Furthermore, there are subgroups with constant characteristics (e.g., sections or 
departments of a firm or an institution), so that each individual is a member of one 
subgroup. The number of members of a certain state is a measurable macro variable. The 
socioconfiguration of, e.g., a company is a set of macrovariables describing the 
distribution of attitudes, opinions, and actions among its subgroups at a particular time. 
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The total macroconfiguration is given by the multiple of material configuration and 
socioconfiguration. 

If all macrovariables of a macroconfiguration remain constant over time, the 
social system is in a stationary macroscopic equilibrium, which can be compared to 
thermodynamic equilibrium. If there are dynamics, we must consider the transition rate 
between macroconfigurations by either increasing or decreasing macrovariables. In the 
case of material configuration, an elementary change consists of the increase or decrease of 
one macrovariable (e.g., the price of commodities) by one appropriately chosen unit. The 
elementary change in the socioconfiguration takes place if one individual of a subgroup 
changes its state, leading to an increase or decrease in the number of a subgroup by one 
unit. For example, the variable of employment is diminished or enlarged by one person or 
a political voter changes his preferred party in a certain period of time. These transitions 
of individual states should be described by a probabilistic process, because the individual 
freedom of decision and action should not be restricted. People are not molecules with 
deterministic microdynamics. Nevertheless, the phase transitions must take into account 
running trends and motivations in order to get a realistic estimate of the probabilities. 
These a spects p rovide t he 1 ink b etween t he microlevel o f individual d ecisions a nd t he 
macrolevel of collective behaviour. There are well-known statistical procedures of data- 
mining to measure probabilistic trends, motivations, and attitudes of people belonging to 
certain sections and subsections of a society. 

The probabilistic phase transitions can be used for setting up the 
macroevolution equation of a social system. The probabilistic macrobehavior of a society 
is described by a probability distribution function over its possible socioconfigurations at 
a certain time. The distribution function P(m, n; t) can be interpreted as the probability of 
finding a certain macroconfiguration of material configuration m and socioconfiguration 
n at time t. The evolution of the social system is the time-depending change of its 
probabilistic macrobehavior, i.e. the time derivative of the probability function dP{m, n\ 
t)ldt. Thus, we get a stochastic nonlinear differential equation which is well-known in 
thermodynamics as master equation. In natural science (e.g. thermodynamics), the 
evolution of a whole ensemble of millions of equally prepared but probabilistically 
evolving systems (e.g. gas, fluids) can often be measured. Therefore, the master equation 
with its probabilistic distribution function of macrostates is appropriate in natural 
sciences, although only numerical solutions are in general available. This method of 
modelling macrodynamics is called ensemble approach. 

But social sciences (e.g. economics, politics, sociology) only dispose of one or at 
best of a few comparable systems. Therefore, the probability distribution of the master 
equation contains too much information in comparison to the available empirical data. 
Sociodynamics focuses on the stochastic evolution of a single system in which it 
traverses probabilistically a sequence of system states. In the corresponding state space of 
socioconfigurations, we get stochastic trajectories describing the probabilistic dynamics 
of s ocial systems. T he stochastic e volution o f a si ngle social sy stem i s d etermined b y 
autonomous nonlinear differential equations for the stochastic trajectories of material, 
extensive and intensive personal variables. In this sense, the emergence of social 
structures and patterns of behaviour can again be modelled by solutions of nonlinear 
equations. 

An example of social phase transitions and symmetry breaking is provided by 
world-wide migration processes. The behaviour and the decisions of people to stay or to 
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leave a region are illustrated by spatial distributions of populations and their change. The 
models may concern regional migration within a country, motivated by different 
economic and urban developments, or even the dramatic worldwide migration between 
poor and rich countries in the age of globalization. The migration interaction of two 
human populations may cause several macro-phenomena, such as the emergence of a 
stable mixture, the emergence of two separated, but stable ghettos, or the emergence of a 
restless migration process. In numerical simulations and phase portraits of the migration 
dynamics, the macro-phenomena can be identified with corresponding attractors. The 
empirical administrative data can be used to test the models. 

Another model of two competing firms provide a bifurcation into winner and 
loser at a critical value of competition. In nonlinear dynamics, order parameters of the 
macrodynamics of a system are introduced by linear-stability analysis. The idea of the 
model is that quality is the order parameter of competition dominating all other economic 
aspects. Thus, parameters of, e.g., prices, supply, or purchase activities of customers can 
beneglected, and we getan macroevolution equation of quality. The evolution of the 
quality variables q, for firm i = 1 and firm i = 2 can be investigated numerically. Their 
(stationary) solutions are depicted as a function of the competition parameter <j>. It turns 
out that both firms have the same stationary quality q(f) of their products and also the 
same stationary market share, as long as the competition value <(> is smaller than a critical 
value <f c . At <j ) c , a bifurcation occurs and for <j> ><j) c there exist two stable quality values q+{<f>) and 
qX<f). The winning firm, say i= 1, will have reached the quality q+(f), whereas the losing 
firm, i = 2, arrives at quality <?_($) with corresponding market shares. 

Economic dynamics is concerned with fluctuations in the economy. Most 
economic variables exhibit perpetual fluctuations over time. These fluctuations are 
characterized by growth of production and employment as well as large oscillations in 
relative changes or growth rates The fluctuations vary from more or less regular business 
cycles in macroeconomic variables to very irregular fluctuations, e.g., in stock prices and 
exchange rates, in financial markets. Again, we distinguish linear and nonlinear 
explanations of the fluctuations. According to the traditional new classical point of view, 
the main source of fluctuations is to be found in exogenous, random shocks to an 
inherently stable, often linear economic system. Without any external shocks and 
disturbances, the economy would be stable and converge to the unique steady-state path. 
Actually, simple linear systems buffeted with noise could mimic time series similar to 
those in real business cycle data. According to the opposing point of view, economic 
fluctuations are not caused by random impulses, but should be explained by nonlinear 
economic laws. It is an old Keynesian topic that fluctuations can also be driven by 
volatile, self-fulfilling expectations of market psychology. 

In the 1940s and 1950s N. Kaldor, J. Hicks, and R. Goodwin developed 
nonlinear dynamic models with locally unstable steady states and stable limit cycles as an 
explanation for business cycles. But these early nonlinear models were criticized because 
of forecasting errors. Further on, from a dogmatic point of view, they suffered from the 
fact that their laws of behaviour were not derived from the traditional belief in rationality 
in the sense of utility and profit maximizing principles. Inspired by chaos theory, 
economists have looked for low deterministic chaos in economic and financial data like 
in natural sciences. But methods like the correlation dimension test need very long time 
series and depend very sensitively on noise. Therefore, the evidence of low-dimensional 
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deterministic chaos in economic and financial data is still low, but nonlinearity in general 
is an increasing challenge. 

Contrary to dynamical systems of the natural sciences, an economy is an 
expectation feedback system. Contrary to, e.g., molecules in a gas, decisions of economic 
agents are based on their expectations and beliefs about the future state of the economy. 
Through these decisions, expectations feed back into the economy and affect several 
economic variables. In the stock market, e.g., this process may lead to a self-fulfilling 
speculative bubble. Nonlinear dynamics, the possibility of wild fluctuations, turbulence, 
chaos and its limitations of predictability shed new light on the expectations hypothesis. 
In a linear stable economy, agents can learn to have rational expectations in the long run. 
But in a complex nonlinear world, with prices and quantities moving irregularly on 
chaotic attractors and sensitivity to initial conditions, a boundedly rational world view 
seems to be more appropriate. Obviously, there are rational and nonrational agents. 
Therefore, heterogeneous agents are used in, e.g., financial market modelling. In this 
case, an economy is considered a complex evolving system of many different, boundedly 
rational, interacting traders with strategies, expectations realizations co-evolving over 
time. Fundamentalists base their investment decisions upon market fundamentals such as 
dividends, growth indicators, etc., but chartists only pay attention to patterns and trends 
in past prices. An evolutionary competition between them may lead to irregular switching 
between the different strategies with the result of price fluctuations. In evolutionary 
economies in the Schumpeterian sense, adaptive learning and innovations are also 
possible. Finally, nobody knows the economic solution: nonlinear dynamics decides who 
is right like in natural evolution. 

Nevertheless, the question arises: what can we leam from time series analysis of, 
e.g., financial data which deliver the measure of our political and economic decisions. 
Stability and welfare of our societies depend sensitively on the dynamics of international 
financial markets. We already mentioned that, in general, we do not know the 
microscopic motions of economic data and agents. Therefore, in 1900, the French 
mathematician L. Bachelier considered the fluctuations of stock prices as statistical 
random walk (Brownian motion) before physicists like A. Einstein (1905) discovered it 
in the microscopic motion of small particles in fluids. Brownian motion does not only 
imply statistical stationarity of price increments and scaling of prices (i.e. invariance 
under displacement and change of scale), but also independence of price increments 
(knowing the past brings no knowledge about the future), continuity of price variation (a 
sample of Brownian motion is a continuous curve), rough evenness of price changes 
(normal Gaussian distribution or “white noise”), absence of clustering (no emergence of 
local patterns and structure) and absence of cyclic behaviour. Further on, Gaussian 
distribution leads to the assumption of an efficient market and successful arbitraging with 
prices following a martingale: whether the past is known in full, in part, or not at all, 
price changes over all future time spans have zero as expectation. 

Modem theory and practice of finance is still more or less based upon these 
fundamental beliefs. What makes an investment in the stock market risky is that there is 
a spread of possible outcomes. The usual measure of this s pread i s b elieved to be the 
standard deviation or variance in a bell-shaped (Gaussian) normal distribution. On this 
basis, H. Markowitz (1952) suggested his well-known construction of portfolios in order 
to diversify away unique risk. A stock’s contribution to the risk of a fully diversified 
portfolio depends on its sensitivity to market changes which is measured by a parameter 
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‘beta’. Beta delivers the benchmarks for the expected risk premium which, since the mid- 
1960s, was calculated by the capital asset pricing model (CAPM). Bachelier did not only 
suggest the random walk of price changes, but also considered the effects of investing in 
options. A breakthrough in 1973 was the famous Black-Scholes formula calculating the 
present call option when there is a continuum of possible future stock prices on the basis 
of a normal (Gaussian) distribution. Every day dealers on the options exchanges still use 
this formula to make their trades. 

Brownian motion is mathematically more manageable than any alternative. But, 
unfortunately, it is an extremely poor approximation to financial reality. Since the end of 
the 1980s, we can observe financial crashes and turbulences deviating significantly from 
normal distribution. Investment portfolios collapsed and hedging with options a la Black- 
Scholes failed. From the viewpoint of dynamical systems, patterns of time series analysis 
illustrate the failures of traditional financial theory. While a record of Brownian motion 
changes looks like a kind of ‘grass’ with normal length, a record of actual price changes 
looks like an irregular alternation of quiet periods and bursts of volatility that stand out 
from the normal length of the grass. This feature demonstrates the apparent non- 
stationarity of the underlying rules. Further on, discontinuities appear as sharp peaks 
from the normally distributed Gaussian ‘grass’. These peaks are not isolated but bunched 
together. Cyclic (but not periodic) behaviour can be observed. Instability of the sample 
variance is expressed by a long-tailed distribution price changes. Last but not least, there 
is a long-term dependence of data. 

Financial markets display some common properties with fluid turbulence. As for 
fluid turbulent fluctuations, financial fluctuations have intermittency at all scales. In fluid 
turbulence, a cascade of energy flux is known to occur from the large scale of injection to 
the small scales of dissipation. Since the 1980s, these cascades lead to multifractal fields. 
In finance, the picture of a cascade of information flowing from large-scale investors to 
small scale ones has been proposed. The fluctuations of various financial time series 
possess multifractal statistics, abandoning the traditional Brownian motion picture. The 
financial system is no longer a linear, continuous and rational machinery, but 
characterized by nonlinearities and multifractals. B.B. Mandelbrot reflected two stories in 
the Bible, those of the flood (Noah effect) and the Seven Fat and seven Lean Cows 
(Joseph effect), in order to illustrate discontinuous jumps and long dependence. He 
suggested several parameters (e.g., Hurst coefficient) and criteria (rescaled range analysis 
R/S) to measure these effects statistically. 

In the nonlinear and fractal approach of the financial system randomness can no 
longer be restricted to the ‘normal’ Gaussian distribution of price changes. We must 
consider degrees of randomness. Gaussian distribution corresponds to a pattern of time 
series with a ‘normal’ length of ‘grass’ without extreme peaks. Therefore, it is called 
mild randomness which can be compared to a solid state of matter aggregation with low 
energy, stabile structure and defined volume. Wild randomness resembles the gas phase 
of matter with high energy, less structure and no defined volume. Slow randomness 
means the fluid state between the gas and solid state. From the viewpoint of time series, 
mild randomness corresponds to short- and long-run evenness. Slow randomness 
corresponds to short-run concentration and long-run evenness. Wild randomness 
corresponds to short- and long-run concentration. 

The financial system is not only nonlinear and fractal, but has a typical trade 
time. It is the interior time of the financial system which must be distinguished from the 
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‘exterior’ time of clocks. Professional traders talk about ‘slow’ and ‘rapid’ markets 
depending on their calculation of volatility: in periods of high volatility and business, 
time seems to run. But during low volatility, time seems to be slow without occurrences 
and action. It is remarkable that the psychological interior time of our brains correspond 
to the interior trade time of the financial system. Statistically, the trade time is a new time 
scale of clock time which is transformed by multiplicative cascades into multiffactal 
periods, according to high or low volatility. The main application of the nonlinear and 
multiffactal approach is perhaps a better predictability. But, at least, the failures of the 
classical financial system can be recognized, and risks can be better calculated. 
Obviously, the global financial markets are governed by wild and dangerous dynamics 
like turbulences, hurricanes, and tsunamis in nature which must not be underestimated. 


4. Complexity and Nonlinear Dynamics of Globalization and Management 


Besides selection and diversity, fluctuations are needed as causes of change. In 
biological evolution, mutations are random events leading to new organisms that must 
survive the biological competition of selection. In economy, technical inventions and 
scientific discoveries are more or less random events leading to innovations that must 
become successful products in the economic competition of markets. It is obvious that 
diversity, self-organizing competition, and innovation are basic principles of complex 
dynamical systems in general. Therefore, globalization is not a political ideology we may 
like or dislike. It is a lawful, nonlinear process that we should analyze in order to handle 
it and to find solutions according to human interests. 

Under the conditions of nonlinear dynamics, it is not sufficient to have good 
intentions, which could lead to undesired side-effects in the long run. Thus, for decisions 
in nonlinear dynamics, one must consider an appropriate window of time. Dynamical 
systems in nature and society have different scales of time. In democracies, politicians 
prefer to take into account short-term effects only, because they want to be elected again 
in the next election. Political power in democracies means power for an elected period. 
This is the reason why political decisions with short-term benefits may lead to 
disadvantages in the economic system with longer periods of causal effects. If, e.g, the 
central bank of a state enlarges the set of money, the first effect is an expansion of the 
gross national product and employment, which is followed by increasing prices and 
wages with a contractive effect. On the other hand, the restriction of money at first has a 
contractive effect on the gross national product and employment, which is later on 
followed by stabilized prices, wages, and an increasing gross national product. As 
politicians prefer the short-term benefits, there is permanent inflationary tendency 
endangering the value of money. 

Globalization enlarges free markets from nations to the whole world. In 
international competition, the industry of a country is only competitive as long as the 
costs of production and services are not higher than the prices that can be gained for its 
goods on international markets. The most important part of costs is the labour costs. 
Therefore, the labour costs of a country must not be too high. The wages generated by 
international competition are called competitive wages. They are a critical control 
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parameter for the international competitiveness of a country. I f c ompetitive wages are 
surpassed by a country for a longer time, then the economy will decrease with high 
unemployment, dramatically diminished exports and enlarged imports. Finally, the wages 
must be decreased again. The contrary effect happens if, on the other hand, the actual 
wages are massively lower than the competitive wages. There is a boom with increasing 
exports, decreasing imports, growing profits and increasing employment. With the 
increasing demand for labour the wages also increase and adjust themselves to the 
competitive wages. 

In the age of globalization there is international competition between many 
countries in trying to attract firms and industries from abroad. They compete with their 
different forms of welfare systems, taxes, and other local conditions. Sociodiversity is a 
feature of complex social and economic dynamics. In complex systems, nobody knows 
the best solutions. It is a question of learning steps and experience by trial and error. 
According to F. von Hayek, competition is a procedure of discovering the best solutions. 
In the age of globalization, the discovering process of competition is generalized for 
countries and nations. They emerge as global attractors in the worldwide dynamics of 
free markets. 

On the national level, countries organize themselves with their political and 
economic systems. National governance is realized by national governments legitimated 
by democratic elections in the best case. Governance needs power to enforce laws, 
regulations, and norms. How should global governance be made possible in the age of 
globalization? After the Second World War the General Agreement on Tariffs and Trade 
(GATT) was the first step in this direction. GATT was a global, political framework of 
nations that wanted to take part in free markets. After 1989, GATT was improved by the 
World Trade Organization (WTO) with free trade of further products and services. With 
respect to the increasing importance of inventions and their protection by patents, the 
WTO was supplemented by an agreement on Trade Related Aspects of Intellectual 
Property Rights (TRIPS). The WTO enforces its national members to satisfy the global 
mles of their agreement. Otherwise a country is excluded from the privileges of free 
markets by the other members. But the attraction of free markets is very strong and 
supports the national interest of a country. Therefore, any member tries to avoid such a 
situation voluntarily. In this sense the WTO has an effective system of sanctions that are 
applied by an international court of trade. It is remarkable that for the first time in history 
a political-economic system is able to enforce sanctions without military power. Military 
power is even excluded, because otherwise a country loses the economic benefits of the 
free WTO-market. 

Mankind's urgent global problems like war, poverty, and ecological pollution 
cannot be solved, because there are no effective systems of sanctions. Good intentions are 
not sufficient. The WTO with its effective sanctions could be a model for successful 
global governance. Less developed countries have obviously less chance to compete 
successfully with highly developed countries on the monetary market. They need help to 
improve their financial systems. Nevertheless many of them can already compete with 
their human capital, i.e. the know-how of their people. Thus the best help is to open the 
markets of wealthy OECD countries for these people. There is no better way to gain the 
knowledge of competitors than by competing with them. 

Globalization means the critical phase transition to global governance in the 
world. We need new global structures to manage the political, economic, military, and 
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technological power in the world according to the interests of the majority of people on 
earth. Global structures emerge from the nonlinear interactions of peoples, nations, and 
systems. At the end of the 18th century, Kant had already demanded a law of nations 
leading ‘To Eternal Peace ’ (1795). After the First World War, President W. Wilson of the 
United States strongly influenced the foundation of the League of Nations. After the Second 
World War, the U nited N ations (UN) p resented a n ew c hance t o h andle i ntemational 
conflicts, but they often fail because of their lack of power. The dilemma of international 
law is that law needs power to enforce rights and ethical norms. Therefore nations have to 
give up parts of their sovereignty, in order to be dominated by commonly accepted ‘ order 
parameters'. Clearly it is a long way to global governance among autonomous nations. 
On the other hand, we must not forget the practical progress made by new social and 
humanitarian institutions of the UN. New economic, technological, and cultural networks 
of cooperation emerge and let people grow slowly together in spite of reactions and 
frictions in political reality. On the way to ‘eternal peace’, Kant described a federal 
(multi-component) community of autonomous nations self-organizing their political, 
economic, and cultural affairs without military conflicts. But an eminent working condition 
of his model is the demand that states organize their internal affairs according to the civil 
laws of freedom. 

Are there consequences of complexity and nonlinear dynamics for management 
systems in the age of globalization? Linear decision behaviour can obviously lead to 
desired results only under the conditions of complete information in an environment with 
linear dynamics. In complex situations, agents must consider positive and negative 
feedback b y side e ffects oft heir o wn nonlinear d ecisions a nd b y g oals a nd a ctions o f 
other agents. Short-term thinking is dangerous in a world with delayed and long-term 
side effects. Learning in complex organizations means a change of mental models, 
strategies and decisions. It requires nonlinear information feedback. Thus, we should aim 
at improving complexity in management systems with respect to structural complexity 
(e.g. flat hierarchies, short length of decision processes, appropriate number of 
controlling units), with respect to information complexity (e.g. effective knowledge 
management, information symmetry and transparency), and finally with respect to the 
individual complexity of co-workers and the diversity of their different creative 
potentials. 

But diversity and complexity do not automatically lead to the emergence of self¬ 
organizing fruitful effects. In firms, administrations, and other kinds of organizations, we 
can measure costs of complexity influencing their position in economic competition. 
Direct costs of complexity are distinguished as single direct costs for too complex 
products with new expensive materials, tools, and features, and permanent direct costs for 
service and administration of these products. Indirect costs of complexity are hidden in 
the organizational structure of a firm or administration. An example is the time of a 
manager or co-worker not being optimally used. Costs of complexity influence all steps 
of the value chain during an industrial production. There are, for instance, the costs of 
suppliers for various units of products. Furthermore, costs of complexity emerge in 
purchase and logistic, production and construction, marketing, and administration. If 
dangerous drivers and traps (“attractors”) of complexity arise, the capital of a firm 
decreases and the energy of co-workers and managers are dissipated. Examples are offers 
of firms with a too much variety, over-engineering and defects in quality. 
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Thus, complex nonlinear organizational structures can lead to increasing 
butterfly effects, spreading to the whole organization (e.g. costs of complexity) like an 
epidemic. In complex organizations, nonlinear processes cannot be forecast in the long 
run. Early controlling is necessary to prevent chaotic attractors, i.e. the traps of 
complexity. In the competition of globalization, complex organizations only survive as 
learning, rapidly adapting, and flexible systems. In complex organizations, v arieties of 
competent co-workers recognize problems better and react faster than central controlling 
in an over-regulated hierarchy. Therefore, we should deregulate and support self¬ 
regulating autonomy. Complex organizations are nonlinear social systems of people with 
different abilities, attitudes, emotions and interests. The sociodiversity of people is the 
human capital for a sustainable progress, not only in single organizations, but in the 
evolutionary process of globalization. 


5. Complexity and Nonlinear Dynamics of Computational and Information Systems 


Dynamical systems can be characterized by information and computational concepts. A 
dynamical system can be considered as an information processing machine, computing a 
present state as output from an initial state of input. Thus, the computational efforts to 
determine the states of a system characterize the complexity of a dynamical system. The 
transition from regular to chaotic systems correspond to increasing computational 
problems, according to increasing degrees in the computational theory of complexity. In 
statistical mechanics, the information flow of a dynamical system describes the intrinsic 
evolution of statistical correlations. In chaotic systems with sensitivity to the initial states, 
there is an increasing loss of information about the initial data, according to the decay of 
correlations between the entire past and future states of the system. In general, dynamical 
systems can be considered as deterministic, stochastic or quantum computers, computing 
information a bout p resent o r f uture s tates f rom initial c onditions b y t he c orresponding 
dynamical equations. In the case of quantum systems, the binary concept of information 
is replaced by quantum information with superposition of binary digits. Thus quantum 
information only provides probabilistic forecasts of future states. 

The idea to conceive dynamical systems as automata dates back to the 
mechanistic world-view of the 17 th and 18 th century. In the philosophy of Leibniz, even 
organic systems are considered as “natural automata surpassing all artificial automata 
infinitely”. John von Neumann’s concept of cellular automata gave the first hints of 
computational models of living organisms conceived as self-reproducing automata a self¬ 
organizing complex systems. The phase space is a homogeneous lattice which is divided 
into equal cells like a chess board. An elementary cellular automaton is a cell which can 
have different states, for instance, binary states of ‘black’ (1) and ‘white’ (0). An 
aggregation of elementary automata is called a composite or complex automaton. Each 
elementary automaton is characterized by its environment, i.e. the neighbouring cells. 
They change their states according to Boolean transformation rules depending on their 
cellular environments. The dynamics of a complex automaton is determined by 
synchronous applications of the transformation rules producing cellular patterns of black 
cells. These clusters can be considered as attractors the dynamics of cellular automata 
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aim at. Thus, there are classes of automata with fixed points and oscillating patterns, 
independent of initial cellular configurations, contrary to chaotic patterns of automata, 
depending sensitively on tiny changes of initial configurations. 

Unlike Turing-like program-controlled computers, the human brain is 
characterized by fuzziness, incompleteness, robustness, and resistance to noise, but also 
by chaotic states, dependence on sensitive initial conditions, and last but not least by 
learning processes. These features are well known in the nonlinear complex system 
approach. Concerning the architecture of Turing-like computers and complex systems, an 
essential limitation derives from the sequential and centralized control of Turing-like 
computers, but nonlinear complex dynamical systems are intrinsically parallel and self- 
organized. 

The information processing of the human brain is simulated by complex neural 
networks with learning algorithms. From a technical point of view, neural nets are 
complex systems of cells with different layers like the architecture of our cortex. 
Neurochemical interaction of cells is simulated by numerical weights of input data which 
affect firing or non-firing of technical neurons in dependence of certain threshold values. 
In this manner, microscopic neurons connect themselves in macroscopic patterns. There 
is no central processor or commanding neuron that can think or feel. Cognitive features 
of the brain are correlated to macroscopic patterns of connected neurons. Perceptions are 
transformed into neural maps o f the brain which c an b e characterized b y macroscopic 
order parameters. 

Concerning the philosophical mind-body problem, the complex system approach 
states that cognitive activity is neither completely independent and different from brain 
activity nor simply identical, nor an epiphenomenon. Thoughts and feelings are assumed 
to be both product and producer of neural processes without being identical to them. In 
the framework of complex systems, the brain is modelled as a self-organizing system 
which operates far from thermal equilibrium and close to certain threshold values as 
instability points. During neural instability, different modes of collective excitations 
evolve to coherent macroscopic patterns which are neurophysiologically based on certain 
cell assemblies and psychologically expressed as certain feelings or thoughts. 

Cognitive and emotional phenomena are referred to macroscopic properties of 
the brain’s dynamics and to order parameters of awareness which govern the underlying 
microscopic processes. In a situation of emotional instability, for example, a certain 
feeling may dominate the other ones. The competition of stable and instable modes is 
explained by the slaving principle. In a situation of decision one thought or concept 
begins to enslave the other possible ones. These non-equilibriumphase transitions are 
governed by very few order parameters of preference and awareness. 

Thus the complex system approach offers a research program to bridge the gap 
between brain research and cognitive science. In a famous metaphor, Leibniz compared 
the machinery of a human brain and body with the machinery of a mill which can be 
entered and observed. In modem brain research, the interacting cog wheels of the mill are 
the firing and non-firing neurons which could be technically constructed by a neural net. 
If the human brain is considered as a complex dynamical system, then emergence of 
mental states can be modelled by phase transitions of macroscopic order parameters 
which are achieved by collective nonlinear interactions of neurons, but which are not 
reducible to microscopic states of the system: A single neuron cannot think or feel. The 
complex system approach is an empirical research program which can be specified and 
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tested in appropriate experimental applications to understand the dynamics of the human 
cognitive system. Further on, it gives heuristic devices to construct artificial systems with 
cognitive features in robotics. 

In a dramatic step, the complex systems approach has been enlarged from neural 
networks to global c omputer n etworks like the World Wide W eb. The Internet can be 
considered as a complex open computer network of autonomous nodes (hosts, routers, 
gateways, etc.), self-organizing without central control mechanisms. The information 
traffic is constructed by information packets with source and destination addresses. 
Routers are nodes of the network determining the local path of each packet by using local 
routing tables with cost metrics for neighbouring routers. A router forwards each packet 
to a neighbouring router with lowest costs to the destination. As a router can only deal 
with one packet, other arriving packets at a certain time must be stored in a buffer. If 
more packets arrive than a buffer can store, the router discards the overflowed packets. 
Senders of packets wait for confirmation message from the destination host. These 
buffering and re-sending activities of routers can cause congestion in the Internet. A 
control p arameter of data density is defined by the propagation of congestion from a 
router to neighbouring routers and dissolution of the congestion at each router. The 
cumulative distribution of congestion duration is an order parameter of phase transition. 
At a critical point, when the congestion propagation rate is equal to congestion 
dissolution, fractal and chaotic features can be observed in data traffic. 

Congested buffers behave in surprising analogy to infected people. If a buffer is 
overloaded, it tries to send packets to the neighbouring routers. Therefore the congestion 
spreads spatially. On the other hand, routers can recover when the congestion from and to 
the own subnet are lower than the service rate of the router. That is not only an 
illustrative metaphor, but a hint on nonlinear mathematical models describing true 
epidemic processes like malaria extension as well as the dynamics of routers. Computer 
networks are computational ecologies. The capability to manage the complexity of 
modem societies depends decisively on effective communication networks. 

It is not only a metaphor to transform the Internet to a superbrain with self¬ 
organizing features of learning and adapting. Information retrieval is already realized by 
neural networks adapting to the information preferences of a human user with synaptic 
plasticity. In sociobiology, we can 1 earn from populations of ants and termites how to 
organize traffic and information processing by swarm intelligence. From a technical point 
of view, we need intelligent programs distributed in the nets. There are already more or 
less intelligent virtual organisms (‘ agents’ ), learning, self-organizing and adapting to our 
individual preferences of information, to select our e-mails, to prepare economic 
transactions or to defend the attacks of hostile computer viruses, like the immune system 
of our body. 

Complexity of global networking does not only mean increasing numbers of 
PC’s, workstations , servers, and supercomputers interacting via data traffic in the 
Internet. Below the complexity of a PC, cheap and smart devices of low-power are 
distributed in intelligent environments of our everyday world. Like GPS (Global Position 
System) in car traffic, things of everyday life could interact telematically by sensors. The 
real power of the concept does not come from any one of these single devices. In the 
sense of complex systems, the power emerges from the collective interaction of all of 
them. For instance, the optimal use of energy could be considered as a macroscopic order 
parameter of a household which is realized by the self-organizing use of different 
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household goods according to less consumption of electricity during special time periods 
with cheap prices. The processors, chips and displays of these smart devices do not need 
a user’s interface like a mouse, windows, or keyboards, only just a pleasant end effective 
place to get things done. Wireless computing devices of small scales become more and 
more invisible to the user. Ubiquitous computing enables people to live, work, use, and 
enjoy things directly without being aware of their computing devices. 


6. What can we learn from Nonlinear Dynamics of Complex Systems? 


What are the human perspectives in these developments of dynamical, information, and 
computational systems? Modem societies, economies and information networks are 
highly dimensional systems with a complex nonlinear dynamics. From a methodological 
point of view, it is a challenge to improve and enlarge the instalments of modelling from 
low to high dimensional systems. Modem systems science offers an interdisciplinary 
methodology to understand typical features of self-organizing dynamics in nature and 
society. As nonlinear models are applied in different fields of research, we gain general 
insights into the predictable horizons of oscillatory chemical reactions, fluctuations of 
species, populations, fluid turbulence, and economic processes. Obviously, nonlinear 
modelling explains the difficulties of the modem Pythias and Sibyls. 

The reason is that human societies are not complex systems of molecules or ants, 
but the result of highly intentional acting beings with a greater or lesser amount of free 
will. A particular kind of self-fulfilling prophecy is the Oedipus effect in which people 
like the legendary Greek king try, in vain, to change their future as forecasted to them. 
From a macroscopic viewpoint we may, of course, observe single individuals 
contributing with their activities to the collective macrostate of society representing 
cultural, political, and economic order ( order parameters). Yet, macrostates of a society, 
of course, do not simply average over its parts. Its order parameters strongly influence the 
individuals of the society by orientating their activities and by activating or deactivating 
their attitudes and capabilities. This kind of feedback is typical for complex dynamical 
systems. If the control parameters of the environmental conditions attain certain critical 
values due to internal or external interactions, the macrovariables may move into an 
unstable domain out of which highly divergent alternative paths are possible. Tiny 
unpredictable microfluctuations (e.g., actions of very few influential people, scientific 
discoveries, new technologies) may decide which of the diverging paths in an unstable 
state of bifurcation society will follow. 

Therefore, the paradigm of a centralized control must be given up by the insights 
in the self-organizing dynamics of highly dimensional systems. By detecting global 
trends and order parameters of complex dynamics, we have the chance of implementing 
favourite tendencies. By understanding complex system we can make much more 
progress in evaluating our information technologies and choosing our next steps. 
Understanding complex systems supports deciding and acting for a sustainable future of a 
complex world. 
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FRACTALS, COMPLEXITY AND CHAOS 
IN SUPPLY CHAIN NETWORKS 
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Recent work identifying an equilibrium solution in a supply chain network through cooperation and 
coordination along edges (links) in the network identifies the links as the stochastic modelling 
entities rather than the nodes of the network. This has been generalized to a supply chain network 
where the equilibrium solution applies to interactions between components of supply chain 
networks. We introduce the concept of a component decision-maker in a supply chain as a fractal. 

With the aid of a simple transformation we outline features of self-similarity, invariance, chaos and 
feedback mechanisms, and examine some repeating patterns in prediction capability control charts. 

We also discuss fractal geometry in the evolution of supply chain networks. 

1 Introduction 

B.B. Mandelbrot (1982) showed that the early mathematical ‘fractals’ developed by 
mathematicians such as Cantor (1883) and Sierpinski (1915) were far more than odd 
shapes deviating from familiar mathematical constructions. He demonstrated that these 
early fractals have many features in common with shapes found in nature. We will 
introduce a multi-disciplinary problem which incorporates many fractal features 
including self-similarity, invariance, chaos and feedback mechanisms. The problem 
arises in the study of supply chain networks and begins with the classical newsvendor 
problem. This problem addresses the sale of products with a limited selling period. It 
attempts to determine the optimal supply of items that minimises costs or maximises 
profit in the face of uncertain demand. This basic problem is known as the single echelon 
newsvendor problem because there is only one decision-maker. This is the newsboy who 
decides on how many items, Q, to order from the supplier to maximise his profit (see §2). 
The two echelon problem described in §2 (Lau & Lau, 2001; Silver et al., 1998) is an 
extension to two decision-makers such as the manufacturer and the retailer. Pearson 
(2003) introduced new decision variables, which enabled the reformulation of the 
problem by shifting the decision making from the nodes of the network structure to the 
edges, and hence identified an equilibrium solution in the context of a limited amount of 
cooperation between the operators (Carr & Lovejoy, 2000). The first variable is the mix 
variable, which helps to coordinate the allocation policies of the primal and dual 
operators. The second is the global variable, which monitors the overall increase in 
system output. Pearson (2004b) extends the equilibrium solution to components 
consisting of several operators grouped together in the supply chain (Dutta et al., 2003; 
Courtright et al. 1989). The equilibrium solution is then identified for the link between 
the primal-dual components in the same way as it is for the link between the primal-dual 
operators. In this paper we highlight the feature of self-similarity between operators and 
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components in supply chain networks, and introduce the invariance property required for 
the equilibrium solution to be unchanged when decision-making shifts from a simple 
primal and dual operator problem to a simple primal and dual component problem. We 
examine chaotic behaviour exhibited when the bullwhip effect appears in a supply chain. 
We discuss various feedback mechanisms, such as adaptive target control, the target gain 
function and prediction capability control charts (Pearson, 2000, 2004a, 2005), which are 
used to moderate the chaotic behaviour caused by the bullwhip effect and asymmetrical 
market knowledge. We identify common repeating patterns which appear in prediction 
capability control charts, such as the clockwise and anticlockwise patterns revealed with 
push-pull marketing strategies (Pearson, 2005). Fractal geometry is discussed with regard 
to the primal-dual decision-making elements within supply chain structures. §8 contains 
an illustrative example and we end with a conclusion (§9). 

2 The Newsvendor Optimisation Problem 


2.1 The Single Echelon Newsvendor Problem 


In the single echelon problem (Silver et al., 1998) a retailer wants to find the supply of 
items to allocate when demand is uncertain. If F D is the cumulative distribution function 
of the demand, R is the retail price, M is the manufacturing cost, while V e is the salvage 
value for items returned, then the optimal order quantity, Q’ which maximises the 
retailer’s profit is 


Q' 


_ f -u r ~ m ) 


(i) 


2.2 The Two Echelon Newsvendor Problem 

The two echelon newsvendor problem is the problem faced by two decision-makers. One 
is the retailer while the other is the manufacturer. If the retailer orders too many items 
from the manufacturer, so that he has many unsold items at the end of the day, then he 
suffers a consequent loss of income due to high overage (assuming that the products are 
perishable). On the other hand if he orders too few items then stock-outs occur and so he 
suffers lost income as a result of lost opportunity (underage). He may also suffer future 
loss of goodwill from customers who may decide to buy elsewhere in future. The two 
echelons are the two decision-makers (nodes), which are the retailer and the 
manufacturer. The problem is known as the {(C,V),(Q,R)} problem, since the 
manufacturer determines the cost to charge the retailer (Q and the credit per unit to pay 
for unsold units (V). On the other hand the retailer determines the amount of inventory 
(0 to order from the manufacturer and the retail price (R) to charge the customer. The 
objectives of both the manufacturer and the retailer are to maximise profit. The stochastic 
problem has no generalized equilibrium solution under certain basic assumptions 
(Emmons & Gilbert, 1998). One assumption is that the manufacturer and retailer engage 
in sequential rather than simultaneous decision making. If the manufacturer pays the 
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retailer V for each item returned at the end of the season and the manufacturer then 
claims the salvage value, V e , for items returned, the retailer’s solution is to order 

& = F-%R-C)I{R~V)\ (2) 

The manufacturer’s optimisation problem is to find C* that maximizes 

Tl m = (C - M) X F - 1 [(/? - C) /(R - V )], (3) 

where Fl m is the manufacturer’s profit. The retailer is required to substitute the 
manufacturer’s chosen value of C* into (2) to find his optimal order decision Q‘. 

2.3 Modelling Assumptions 

1. We will use the single period inventory model 

2. Unbiased demand and supply fitting or forecast techniques are applied 

3. All prediction errors are normally distributed 

4. The relationship between the standard deviation of the errors and the demand mean 
is well behaved, so that first and second derivatives exist and are continuous 

2.4 Composing a Simple Transformation 

Pearson (2003) proposed a simple transformation called the primal-dual transformation, 
whereby the node decision-making variables in the stochastic model are transposed into 
joint edge variables. 


Prioritise edge over node 

demand Ft 0 ~° ■ 


n = M, +M> 


‘global” 


Figure 1. The Primal-Dual Transformation 

This is illustrated in Figure 1. The primal-dual transformation prioritises edges over 
nodes by considering the stochastic entities defined as the sum (‘global’ variable) and 
difference (‘mix’ variable) of the node demand and supply variables calculated at each 
node associated with the corresponding edge. The primal-dual objective is to maximise 

E {Profit} 

= E {Contribution from captured demand - Costs of overage - Costs of underage} 

= 2 ap x - {2am) - *0 - $(*))) + + <*(*)) + c(<f>(k) ~ *0 - 4>(*))K (4) 


subject to: 
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p - ka e = 0, (Newsvendor Constraint) (5) 

where a is the mean primal-dual profit per unit sold, b is the sum of the primal overage 
and dual underage costs and c is the sum of the primal underage and dual overage costs 
per unit produced. Also E(D) + E(Q ) = rj and E{Q) - E(D) = p and a e (the standard 
deviation of the forecasting errors) depends on p and 77 . 


2.5 Primal-Dual Solution for Variability dependent on ft and Tj 


We solve the stochastic equations (4) and (5) using a Lagrange multiplier (Pearson 2003), 
where the independent variables are k, fl and 77 . The solution is: 

®(k) + m°a 

b+c ( 6 ) 


r?=- 


( 7 ) 


where erf, erf : stand for d<r e /dp and dcrjdrj respectively. Also ^(«) and <£(•) are the 
standard normal distribution density function and cumulative distribution function 
respectively. The assumption A5 helps to maintain the independence between the mix 
and global variables Q-D and Q+D (and so also p and 77 ). As a result both the simplicity 
and the complexity of the solution can be displayed more effectively. Figures 4 and 5 
illustrate the distinct behaviour displayed by the error standard deviation, a e when it is 
plotted against the mix variable, p and the global variable, 77 . 


3 Extension to the Complete Network 
3.1 Supply Chain Entities and Links 

Figure 2 illustrates an operator in the supply chain network. If he looks downstream then 
he acts as a dual operator who has a link to a downstream primal operator. If he looks 
upstream then he acts as a primal operator with a link to an upstream dual operator. We 
employ the transformed link stochastic variables (k,p,rj ) d for the downstream link and 
the variables (k, p, 77 )" for the upstream link. The solution sets associated with the 
downstream and upstream variables are S(k,p,T]) d and S(k,p, 77 )", respectively. 


{S(k,p,rj)) d 
Downstream link 



Figure 2. Dual|Primal Supply Chain Operator 
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The simple structure illustrated in Figure 2 can be extended to a tree structure with a 
simple operator and more than one upstream or downstream links (Pearson, 2004b). The 
combined upstream flow would then be modelled as the upstream flow and the combined 
downstream flow as the downstream flow. 

4 Self Similarity 

We can treat sets of operators as a component. The component then has a total upstream 
and downstream flow and is related to other operators or components in the same way 
that operators are related to each other. The component set is then a collection of copies 
of the operator set with exactly similar dual|primal relations. 

4.1 Chain Structure 

Figure 3 illustrates self-similarity in a simple supply chain network. The dual|primal 
component is a collage of two similar copies of the dual|primal operator. The solution set 
S(k,/u,7j) is associated with the link between the decision-making operators who have 
cooperated by prioritising their edge (link) variables ( k,/i,tj ) over their node variables 
(D,a eD ,Q,c r e ) and agreed to the coordination (newsvendor) constraint, ju - ka e = 0 
where <j e , a e and cr e are the standard deviations of the primal, dual and joint prediction 
errors, respectively. When decisions between components are being addressed the 
solution sets are (S(k,p,Tj)) d and (S(k,/j,t]))“ for the downstream and upstream links 
respectively. Decisions between components reduce the decision-making capacity of the 
operators within the components. 


Dual|Primal - Dual|Prima1 '* 

0pmtor S(k,ju,rj) ° Perat0r - (S(k^,T))) 


DuaI|Prima I 
Component 

Figure 3. Self-Similarity in Simple Chain Structure ( S(k,/i,T]) ) 

4.2 Invariance Property 

We examine conditions where the solution is unchanged by the switch from operator to 
component level decision-making. We have that the expected demand and supply at the 
operator level within the DuaI|PrimaI component illustrated in Figure 1 are: 

E{D) = ju D = dp D +m q )- C u q -P d J)/ 2 =(rj-p)/2 


(S(t, —( 
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E(Q ) = Mg = ((Ad + Vq) + Og - Vd )) 12 =(n + M)l 2 ■ 
Similarly the expected component upstream demand and downstream supply are 
E(D)“ = fip= (rj“ -/r")/2 
E(Q) d = Mg = 0l d +S)I2. 


Now if the solution is unchanged then 



E(D) = E(Q) d and E(Q) = E(D) U 


So that 

TJ-/i = tl d +M d 

(8) 


Tj+p = rj“-p u . 

(9) 

Subtracting (8) from (9) and adding (8) to (9) gives 



» = ({r 1 u -r, d )-{n'-+ t i d ))l2 

(10) 


V = ((> 7 " +rj d )~(M“ ~M d )) 12 

(11) 


This result could occur when the operators have symmetrical market knowledge, so 
that the operators know as much about demand and supply throughout the chain as the 
component decision-makers do. We generally seek conditions based on increased channel 
optimality and capability (Pearson, 2004b) before handing over decision-making from 
operator level to component level, and so the invariance property is not a sufficient 
incentive to change to component level. 

5 Chaos 

5.1 Bullwhip Effect 

The bullwhip effect is a feature of supply chains which up till now has defied simple 
modelling. It describes the counter-intuitive situation whereby orders at the higher 
(upstream) levels of the supply chain can exhibit more variability than those at customer 
(downstream) level. ‘Demand signal processing’, the ‘rationing game’, ‘order batching’, 
and ‘manufacturer price variations’ all increase the bullwhip effect (Silver et al, 1998). 
The effect is also increased if demand variability changes, which is often the case when 
new markets are sought. 

5.2 Asymmetric Market Knowledge 

Pearson (2003) describes the chaotic behaviour in a supply chain when there is an 
increase in both primal and dual variability. Each operator seeks to maintain his level of 
profit achieved during stable operation at the expense of the other operator, which leads 
to disequilibrium when market knowledge is asymmetric. In practice the operator with 
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stable variability penalizes the operator carrying the increased variability. Since the 
downstream operator (retailer) often carries the burden of increased variability, improved 
efficiency tends to pass upstream towards the dual operator (manufacturer), not 
downstream towards the primal operator (retailer). The primal-dual formulation provides 
an equilibrium solution to this complex, asymmetric multi-echelon problem. The 
operators cooperate through limited information exchange and then coordinate their 
allocation strategy. 

6 Feedback Mechanisms 

Feedback mechanisms are a feature of industrial and business processes (Box & Lucemo, 
1997). In the context of fractal problems their establishment counters chaotic behaviour. 
Pearson (2000, 2004a, 2005) proposes three such mechanisms. 

6.1 Adaptive Target Control 

The method of adaptive target control acts as a feedback system which enables 
appropriate capable targets to be selected when a system is not capable of achieving the 
agreed or imposed target values. The targets refer to levels of overage and underage 
which occur when produce is distributed in the supply chain. If a forecasting technique is 
unable to achieve both targets simultaneously (which is what is meant by saying that the 
prediction method is capable of achieving both targets, so that the prediction 
capability, C PR = 1) then a theorem identifies adapted targets, which the prediction 
method is capable of achieving. 

6.2 Target Gain Function 

The target gain function is a feedback mechanism that addresses the problem of 
accurately identifying uncertainty in the measurement of the standard deviation of the 
errors. An interval estimate making use of a target gain function to identify improved 
solutions to the newsvendor problem is introduced. Current practice targets for overage 
and underage are used as the starting point for the identification of improved targets. 

6.3 Primal-Dual Capability Charts 

The prediction capability chart (Pearson 2003, 2005) monitors changes in forecast 
variability as the mix variable changes. Figure 4 illustrates the chart and shows that the 
region of improved optimality associated with a given solution, (x,s) bounded by the 
isovalue line and the // axis, contains within it the region of improved capability. The 
control zone is the area of stable cooperation between the primal and dual operators. It 
can be calculated dynamically from a time series by using a confidence interval 
[ X ± t df a/2 s ] for the mix variable, /J. and a interval [ .V,,,v 2 ] for CT e using the point 
estimate, s, calculated at the optimal solution. The control zone shows when the 
allocation method is out of control. The chart itself acts as a feedback mechanism for the 
decision-maker when allocating inventory. 
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Figure 4. Prediction Capability Control Chart 
6.4 Repeating Push-Pull Patterns 

Out of control points could be corrected by use of equations (6) and (7) (or the 
minimisation of costs solution outlined in Pearson 2003) to identify a new value of k 
which brings the process back into control. The push-pull marketing strategies are 
identified on the prediction capability control plots and charts (Pearson, 2005). The cycle 
of points in the prediction capability chart may follow an anti-clockwise pattern, which is 
typical of the push strategy employed in marketing (Cachon, 2004). This contrasts with a 
clockwise pattern which shows that customer demand for the product generated the 
increase in supply, which tends to happen with the pull strategy. In contrast to the 
prediction capability chart for the mix variable is the primal-dual global plot for the data. 

The global plot of <r e against ij often has a positive slope indicating that the error 
variability increases for higher output levels in the global market. Figure 5 shows the 
efficient frontier (represented by the isovalue line in Figure 4) advancing as output 
increases. This is prevalent in a market where the actions of a competitor may cause 
variability in customer demand which is difficult to predict. 
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Figure 5. Primal-Dual Global Plot 


7 Fractal Geometry 

We break down the geometrical distribution problem into decision making components. 
We formulate the optimisation problem of each component. We apply the primal-dual 
transformation to the links between each component (prioritise edge over node) and 
reformulate the optimisation problem as a primal-dual problem. We then interrogate 
whether the problem has symmetrical or asymmetrical market knowledge and so 
establish whether the invariance property applies. We investigate the bullwhip effect and 
chaotic behaviour. We establish feedback mechanisms. We test for the principles of 
optimality and capability. We then investigate the fractal geometry of the problem, as 
reformulated into new decision-making components. 

8 Illustrative Example 

We consider a manufacturer and retailer who jointly decide which area of the market to 
operate in and the marketing strategy they intend to pursue. Using data drawn from recent 
historical demand and supply patterns they formulate primal-dual capability mix and 
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global plots. Their preferred marketing strategy is the pull mechanism based on 
maintaining a solid customer base. Their strategy is confirmed by: 

1. the clockwise pattern of the capability chart (Figure 4), which shows that surges in 
demand precede the matched supply figures. 

2. the in-control pattern of points on the capability chart (Figure 4). This ensures 
capable operation and optimisation while staying within target margins. This ensures 
viable business operation while maintaining customer satisfaction and goodwill. 

3. the global plot operating at maximum volume output within a low variability 
window of operation. In Figure 5 the current area of operation is set at tj =105 and 
cr, =15 (refer to Figure 4, optimal solution at /u =12 and cr, =15). The proposal is to 
increase volume to the preferred region of operation where 77 =125 and <r e =18. This 
is at the cusp of the efficient frontier before possible chaotic behaviour begins. 

4. the fact that occasional promotional activity which extends operation into the area of 
increased variability (identified from the high volume output, rj >125, in Figure 5) 
gives an anti-clockwise pattern on the capability plot (Figure 4), which indicates a 
change to a push strategy. 

5. the fact that the push strategy may lead to out of control operation beyond the 
extreme of the efficient frontier. Factors such as increased competition and the 
breakdown of coordinated activity within the supply chain become significant. 

The manufacturer (or retailer) may attempt to gain ownership of the supply chain. In this 
case decision-making would shift to the component level consisting of the retailer- 
manufacturer component (Figure 3). The self similar principles would apply to decision¬ 
making at this component level as at the operator level. The owner of the supply chain 
would want, at least, to maintain invariance within the chain, but would hope to increase 
overall capability and optimality (Pearson, 2004b). 

9 Conclusion 

We have identified a fractal (primal|dual) element as a decision-maker in a supply chain 
network who is related upstream with a dual element and/or downstream with a primal 
element. The decision maker can be a single operator in the supply chain, such as a 
manufacturer or distributor, or a group of operators considered as a decision-making 
element called a component. The operators and components display fractal features such 
as self-similarity, invariance (in the presence of the equilibrium solution), chaos, 
feedback mechanisms and fractal geometry in the context of complex supply chain 
network structures. The complexity of such real-life systems is realised within a 
relatively simple modelling framework. Equilibrium, order and harmony are starkly 
contrasted with chaos and the search for corrective feedback mechanisms. We are able to 
realistically model such phenomena as the bullwhip effect and asymmetric market 
knowledge and effectively remedy some of the consequent excesses by using appropriate 
feedback mechanisms. 
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A model for power-law problem in high-income distribution is proposed. This model is so simple 
that we can examine the effect of some differences in rules that allocate different amounts of 
resources to winners and losers in economic competitions where we obtain different power-law 
exponents as well as exact analysis by the master equation. 

Keywords: high income model, power-law distribution, fractals, master equation 


I Introduction 

Economic activities have a very intricate structure which is influenced by many factors 
such as production of natural resources, disasters, labor power supply, relation between 
governments, and so on. The economic system can be viewed as a prototype of complex 
systems. The gains which are mainly obtained after competitions among companies are 
distributed to employees. These processes perform endlessly complicated nests of trades, 
producing incomes from unspecific random objects. Therefore we believe that there is an 
intricate nest of structures and we would like to show an existence of some kind of 
fractality. 

Power-law distributions for high-income have been investigated since 1897 [1 - 8]. 
Other power-law distributions are found in social and economical events such as word 
counting [9], family name distribution [10], firm size [11], fluctuation in finance [12], 
number of passengers at stations [13] as well as in high-income ranking problems. In 
Table 1 we show some power-law exponents of high-income data. In high-income ranking 
problem, it is our main interest to know the reason why the high-income distribution 
shows power-law and what kinds of factors determine the power-law exponent. In 
addition, it is also interesting to investigate what the power-law exponent means in the 
real economical phenomena. In this paper we suggest a model which indicates some 
different power-law exponents depending on competition rules. 
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When we change the competition rule in our model, different power-law exponents 
are obtained. When we can investigate and analyze the relation between the competition 
rule and the power-law exponent sufficiently, it will become clear what is a main 
competition rule that controls our real economics. Our model is simple enough to get an 
exact solution by an analytical method. 

Table 1. Some earlier data of the power-law exponent ( X : Income, P(t>X)\ The probability with income more 
than X, R: The rank means the number of persons who earn more than X. Equation R-~P( t>X) — ■)C a ) 


Year 

Name 

a 

Income Data 

1897 

Pareto 

1.5 

Some Euro cities 

1953 

Champemone 

1.7 

U.K. 1951/1952 

1959 

Lydall 

1.5 

U.K. 1954/1955 

1983 

Montroll, et al. 

1.63 

USA 1935/1936 

1998 

Takayasu, et al. 

0.5 

Model 

2000 

Aoyama, et al. 

2.05 

Japan 1998 

2002 

Yamamoto, et al. 

1.39 

Model 

2002 

Yamamoto, et al. 

1.32 

Japan & USA 1998 

2002 

Kawamura, et al. 

1.0 

Model 


2 Model and Simulation 

A present model is constructed based on real economic activities. Companies, shops and 
people are simply called a member. Each member works to earn money. We assume that 
our system consists of N homogeneous members. The number of members N is fixed. As 
a basic procedure we have the following two steps, which will be modified as given by 
Type 1, Type 2 and Type 3. Each modification will induce a different power in the 
power-law. 

Stepl. One of two members, who are chosen randomly from the members, gets their 
total money after the following competition rule. 

Step2. The total resource money S is kept constant during the process. Each member 

keeps one unit of money as a minimum amount. S is fixed except for the Type 2. 

Type 1 f 14]: One of the two members collects all the money of the two members, 
and the other loses all of one’s resource money. In order to maintain the number of active 
members with resource money, we add one unit of money to the loser. In order to keep 
the whole resource money in our system we reduce one unit from a randomly selected 
member who has the resource money more than or equal to two units. Here, the total 
amount of the resource money S is fixed at 2N. 

Type 2: One of the two members acquires all the money of the two members, and 
the other loses all of one’s resource money. In order to maintain the number of active 
members with resource money, we add one unit of money to the loser. Therefore, the total 



resource money increases by one unit per competition. We relax the above basic 
condition Step2 and the system is simulated under the condition N 2 < S < (N+l) 2 for the 
member N and the total resource money S. 

Type 3: When amounts of the resource money for the two members are different, a 

winner acquires less amount of two resource moneys and the other loses the same amount 
of money. A winner who has smaller amount of money doesn’t get all of the money of the 
loser. The remaining part of the rule is almost the same as for Type 1. Here, the total 
resource money S is fixed at IN. 



ranking 


o Type 1 D Type 2 A Type 3 

Fig. 1. Three log-log plots of income against ranking, N =10,000. 

Here the process which consists of a Stepl and Step2 is called as one Monte Carlo step, 
hereafter. Some simulation results of three different types against ranking are shown in 
Fig. 1. The power-law exponent of incomes against ranking of Type 1, Type 2 and Type 3 
are -0.717, -2.026 and -1.006, respectively. Simulation results of the frequency F(X) 
against the income X are shown in Fig.2 for three different types. The power-law 
exponent of the frequency F(X) against the income X of Type 1, Type 2 and Type 3 are 
-2.45, -1.55 and -1.98, respectively. Now we compare above exponents with a in Table 
1. We calculate the exponents of the cumulative quantity of Type 1, Type 2 and Type 3, 
-1.45, -0.55 and -0.98, respectively from the exponents of the frequency F(X) in Fig. 2. 
The exponent of Type 1 corresponds to the indices of a of Pareto’s, Champemowne’s, 
Lydall’s, Montroll’s and Yamamoto’s data. The Type 2 corresponds to the index of a of 
Takayasu’s data. The Type 3 corresponds to the index of a of Kawamura’s data. 
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| o Type 1 □ Type 2 a Type 3 | 


Fig. 2. Tree log-log plots of the frequency F(X) against the income X, N =10,000. 


3 Mathematical Analysis 

We introduce a probability P(X) that an arbitrary chosen member holds X units of re¬ 
source money. The master equation is 

dP(X)/dt = (1 - P(l))( 1 - P(l)) + P(2) / (1 - P(l» - P(l) 2 for X=1 (1) 

dP(X)/dt = Zi+ X P(i)P(j) + P(X+1)/ ( 1 - P(l)) - 2P(X) - P(X) / ( 1 - P(l)) 

for X>2, (2) 

where the first and the second terms on the right hand side in Eq.(l) and Eq.(2) are in¬ 
crements of P(l) and P(X) for X >2 respectively. The third term on the right hand side in 
Eq.(l) and the third and the fourth terms on the right hand side in Eq.(2) are decrements 
of P(l) and P(X) for X >2 respectively. In Eq.(l), the first term on the right hand side is 
the transition probability to P(l) from all other states except P(l). The second term on the 
right hand side is the transition probability from P(2) to P(l) ( by reducing one unit from 
the member in order to keep the total resource money S ). The third term is the transition 
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probability from P(l) to P(2). In Eq.(2), the first term on the right hand side is the sum of 
the incoming transition probability to P(X). The second term on the right hand side is the 
transition probability from P(X+1) to P(X) ( by reducing one unit from the member in 
order to keep the total resource money S ). The third term on the right hand side is the 
sum of the outgoing transition probability from P(X). The fourth term on the right hand 
side is the transition probability from P(X) to P(X-1) ( by reducing one unit from the 
member in order to keep the total resource money S ). The similar equation can be seen in 
the cluster-cluster aggregation model and the Smoluchowski equation [15]. But the exact 
solution for such a model is quite difficult and sometimes impossible to obtain. If 
the sticking coefficients are constant for any pair of clusters and the breakup rates are 
specific value in the aggregation model, the generalized equation [16] corresponds to our 
Eq.(2). 

Let us now consider the stationary state in which the probability P(X) is time- 
independent. If (per one Monte Carlo step) the same number of transitions occur in the 
incoming and the outgoing direction, P(X) does not change. This requirement can be writ¬ 
ten mathematically in the following set of equations for Type 1 model. 

(1 - P(l))( 1 - P(l» + P(2) / (1 - P(l» = P(l) 2 for X=1 (3) 

Eh=x P(i)PG) + P(X+1) / (1 - P(l)) = 2P(X) + P(X) / (1 - P(l)) for X>2 . (4) 

We define a generating function G(z) by 

G(z) = I°° x=1 P(X)z x |z|<l, (5) 


then the generating function G(z) of Eq.(3) and Eq.(4) becomes as follows; 

( 1 - P(l)) G(z) 2 + ( z 1 - 3 + 2P(1)) G(z) - P(l) + z = 0 . (6) 


The first derivative of Eq.(6) becomes a trivial equation where z=l. Now if we take the 
2nd derivative of Eq.(6) and let z=l, the quadratic equation of the first moment G'(l) is 
obtained 


( 1 - P(l) ) G'(l) 2 - G'(l) +1=0. (7) 

As the first moment means the expectation, the Eq.(7) has to one real solution. Then we 
can derive the values for G'(l) and P(l); 
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P(l)= 3/4 and G'(1) = <X> = 2. 

When we substitute the value P(l) into Eq.(6), the solution for G(z) becomes as follows; 

G(z) = 3 - 2z"' + 2Z\ 1 - z) 3/2 . (8) 

We immediately obtain the probability P(X) with the aid of the Taylor expansion of the 
function G(z) by taking the X’s derivative of G(z) and dividing it by X!. 

P(X) = 6(2X-2)!/((X+l )!( X — 1 )!2 ZX ). (9) 

If we use Stirling’s formula, the probability P(X) shows the power-law behavior as 
follows; 


P(X) ~ X' 5/2 . (10) 

Therefore the cumulative distribution function is P(>X)~X' 3/2 . This power-law index 
shows good fit of our simulation in Fig.2 and real data on Table 1. We can also derive the 
power-law index of Type 2 model similarly. 
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After a brief description of the basic concepts of synergetics in a qualitative and quantitative manner 
I recall the goals of phenomenological synergetics, semantic synergetics and microscopic 
synergetics. The paper focuses on explicit applications of semantic and phenomenological 
synergetics to psychophysics, decision making, management, and health care. 

1 Synergetics: Its General Frame 

1.1. Goal 

Synergetics is an interdisciplinary field of research that deals with complex systems [1], 
These are systems that are in general composed of many components interacting with 
each other. The interactions and/or components and/or behavior may be complicated. In 
many cases these systems can be considered at the microscopic and the macroscopic 
level. At the microscopic level we are dealing with the individual parts of a system and 
their interactions. A few examples may illustrate the point: in physics the elements may be 
molecules in liquids or gases or electrons in semiconductors or light emitting atoms in 
lasers. In chemistry they are molecules undergoing chemical reactions and perhaps also 
diffusion. In biology they may be cells in an organism or individual animals in species or 
neurons in a brain. In sociology they may be individuals in a society or in economy 
individual companies. These examples do not exhaust the field of synergetics at all. 

In many - if not all - cases just mentioned the individual parts are able to form 
spatiotemporal or functional structures at macroscopic scales, e.g. the molecules in a 
liquid may form specific macroscopic movement patterns of the whole fluid, or people in 
a society may form specific public opinions or social groups, or the neurons in a brain 
may cooperate so as to produce speech or to enable us for pattern recognition. Synergetics 
deals with those systems that are able to form their macroscopic structures by means of 
self-organization, i.e. there is no specific external force necessary to impose the structures 
on the systems, rather they obtain these structures by their own action. 

Synergetics aims at reducing the complexity of a system and as it turns out 
synergetics shows how to control a system indirectly rather than by steering its individual 
parts directly. The central question synergetics asks is “Are there general principles for 
self-organization irrespective of the nature of the individual parts?” At first sight such a 
question may seem absurd because of the quite different nature of the individual parts that 
must be taken into consideration. In spite of this, however, the question can be answered 


155 




156 


in the positive at least for a large range of phenomena provided we focus our attention on 
those situations where the macroscopic behavior of a system changes qualitatively. What 
is meant b y this c an b e b est illustrated by an example taken from ordinary life. While 
water is composed of H 2 0 molecules it can appear in quite different macroscopic states, 
namely liquid water, solid ice or vapor. Consider the transition from water to ice. While 
the molecules by themselves do not change in these two states of aggregation, the 
macroscopic qualities are quite different, e.g. ice has different mechanical, optical, and 
thermal properties than water. Such transitions and similar ones in systems in thermal 
equilibrium have been treated in physics to a large extent both theoretically and physically 
and there is a sizable literature in this field. 

Synergetics on the other hand goes far beyond these phenomena of so-called phase 
transitions because it deals with systems away from equilibrium or with non-physical 
systems which share, however, the same property, namely changing their macroscopic 
properties qualitatively. 

In order to be more explicit I will first discuss basic concepts of synergetics in a 
qualitative way and then briefly indicate a quantitative approach based on mathematics. 


1 . 2 . Basic Concepts 
1.2.1. Qualitative aspects 

We consider as a system an ensemble of elements of which each has well defined specific 
properties and the elements interact with each other. The system is assumed to have a well 
defined boundary that separates it from its surroundings. The system may be influenced 
either from the outside or by itself by means of control parameters, e.g. in physics these 
may be the energy influx into a liquid or into a laser. In brains these may be 
neurotransmitters or hormones, etc. In the theoretical approach it is assumed that these 
control p arameters are kept time-independent, at least for some interval of time. When 
control parameters are changed two situations may occur: the system either adapts 
smoothly or it changes its behavior qualitatively. Such a latter situation is called 
instability. Synergetics studies system close to such instabilities whereby it turns out to be 
possible to extrapolate from this situation into the newly developing stable regime. 

The central insights gained by synergetics are as follows: close to instability points a 
new set of variables, describing the macroscopic behavior, evolves. These are the order 
parameters. They are much less numerous than the originally present individual parts. The 
order parameters determine the behavior of the individual parts via the slaving principle. 
This can b e v isualized bye omparing t he o rder p arameters w ith p uppeteers t hat 1 et t he 
individual puppets dance. But in contrast to the action of a puppeteer and the puppets 
following his or her actions, the individual parts can act on the order parameters. By their 
collective action they generate and maintain the order parameters. This leads to the 
principle of circular causality in which the order parameters determine the behavior of the 
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individual parts which in turn determine the behavior of the order parameters. When we 
go around the circle starting from the individual parts, it appears as if the individual parts 
have found their collective action and thus they are organizing themselves. This is a 
phenomenon of self-organization. On the other hand when we start from the order 
parameters and return to them, the behavior of the system is determined and described by 
the - in general few - order parameters with their low dimensional dynamics. This leads to 
an enormous information compression. 

Order parameters and slaving principle allow us to make contact with chaos theory 
and the theory of fractals which are closely related to each other. As is well known, chaos 
theory studies the complex dynamics of few degrees of freedom. Nevertheless, chaos 
theory has been applied to systems with many degrees of freedom under the assumption 
that those are describable by few degrees of freedom. Quite clearly, our theory on order 
parameters and the slaving principle provides us with a firm basis of the just mentioned 
assumptions. 


1.2.2. Basic concepts: Quantitative 

We consider the system as a dynamical system that is described by its state vector q{t) 


qif) = (q„q 2 ,...,q n ) (1) 

where q x ,q 2 ,...,q n are variables that describe the time-dependence of the states of the 
individual parts. Note that these q t may be vectors by themselves. In the spirit of 
dynamical systems theory we assume that the evolution in time of the state vector can be 
described by evolution equations that we assume in the general form 

■^ = A^ ? ,oj + F(0. (2) 

In it A is a nonlinear function of the state vector at time t and N depends also on a set 
of fixed control parameters a. F{t) represents stochastic forces, i.e. chance events 
acting on the system. Also more general forms of F in which case F depends on the 
state vector q are possible (Ito-Stratonovich calculus). We assume that for a fixed set of 
control parameter values, a solution q to (2) is known. We then study the stability of this 
solution when the control parameter is changed to a new value which at least in general is 
done by linear stability analysis. 

<7o (0 ~*7o+K0 (3) 

This analysis reveals that close to instability points new collective variables can be 
defined, namely the order parameters £,. As the detailed theory shows, the order 
parameters obey equations of the form 
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that describe a low dimensional dynamics. In contrast to conventional dynamic system 
theory, our approach takes into account that the fluctuating forces F are present and play 
just close to instability points a crucial role. The slaving principle states that the state 
vector q can be determined by a specific function / 

= (5) 

where the order parameters and the state q are taken at the same time whereas there is 
still an explicit dependence of / on t because of the fluctuating forces. Eq. (4) expresses 
the result of information compression. The complex system is described by low 
dimensional dynamics of its order parameters. According to the slaving principle the 



Figure 1. Visualization of the behavior of a single order parameter in the case of (non-equilibrium) phase 
transition. The size of the order parameter that is plotted along the abscissa is interpreted as the position of a 
ball in a potential landscape. Upper part: When the control parameter is below its critical value there is a stable 
position of the order parameter at the bottom of the valley. Middle part: Close to a critical value of the control 
parameter the valley becomes very flat, the order parameter is pushed around by stochastic forces. Because a 
restoring force is small, the fluctuations become large (critical fluctuations). Also the order parameter relaxes 
towards its equilibrium point only slowly (critical slowing-down). Lower part: Beyond the critical value of the 
control parameter two valleys occur that in many cases are symmetric. A chance event decides which of the 
valley will be occupied by the order parameter. 
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function / can be calculated to any desired degree of accuracy. From the many explicit 
results on" the low dimensional dynamics I just quote the behavior of a single order 
parameter under the impact of fluctuations (cf. Figure 1). Its behavior can be particularly 
simply visualized. We identify the size of the order parameter with the position of a ball 
in a landscape that is deformed when a control parameter is changed so that an instability 
is reached. A typical sequence of such landscapes is shown in Figure 1 with its legend. 
These brief remarks on the quantitative approach may suffice here. Readers interested in 
details are referred to my book “Synergetics. Introduction and Advanced Topics” (2004). 
From the quantitative results a number of important conclusions can be drawn which have 
led to the following considerations. 


1.3. Phenomenological Synergetics 

As the mathematical approach shows, even a complex system can be described by its 
order parameters, at least in the vicinity of its instability points. There are quite a number 
of systems in which the dynamics of the individual parts as described by Eq. (2) is not 
known or not well known explicitly. However, we may assume that at least in principle 
such equations exist and then we may deduce that also order parameters will exist. This 
leads to the idea to model a complex system by means of suitably chosen order 
parameters. A typical and clear-cut example is provided by our modeling of the finger 
movement by Kelso in which he instructed subjects to move their index fingers in parallel 
at a certain speed. When the speed was increased and exceeded a critical value, suddenly 
an involuntary change to a symmetric finger movement occurred (Figure 2). Here the 
control parameter is obviously the prescribed finger movement frequency whereas the 
order parameter is described by the relative phase between the two fingers. It has been 
possible to model the various aspects of the phenomena of this experiment in great detail, 
thus reinforcing the idea that it is possible to describe even complex systems such as the 
behavior of a human by means of the concept of control and order parameters. 
Furthermore, the proof of the existence of hysteresis, critical fluctuations and critical 
slowing down (cf. legend to F igure 1) h as 1 ed t o a r evolution o f o ur u nderstanding o f 
movement control: this is not achieved by a motoprogram but by self-organization. 



parallel antiparallel 

Figure 2. Spontaneous transition between two coordination patterns during index finger movement. 



1.4. Semantic Synergetics 

In a number of cases it might be difficult to model a complex system even by order 
parameters because quantitative measures are hardly possible. Note, however, that there is 
an increasing tendency to cast even qualitative features such as occurring in psychology 
into a quantitative frame. At any rate in the case of a lack of quantitative order parameters 
one may still describe a system in terms of order parameters that possess only a 
qualitative meaning. 

1.5. Macroscopic Synergetics 

Finally within a field I called macroscopic synergetics the goal is to derive order 
parameters and maybe even evolution equations by means of macroscopically given data. 
A description of these methods is beyond the scope of my article. 


2 An Application to Psychophysics: Ambiguous Figures 

The order p arameter c oncept allows us to model the phenomenon of the perception of 
ambiguous figures in considerable detail [2]. An example for such a figure is shown in 
Figure 3. We attribute two order parameters ^,,E, 2 to the percept of a young lady and an 
old lady, respectively, and also attention parameter X,,X 2 . Just to illustrate the treatment 
of this phenomenon in the frame of phenomenological synergetics by means of order 
parameters we present the corresponding order parameter equations 

4 , ={\-D% l+ %, ( 6 ) 

4 2 ={K-Dh+£ (?) 

with 

D = %+\\. ( 8 ) 

The crucial assumption is in accordance with an earlier proposal by Kohler to assume that 
attention fades away if a pattern has been recognized. Our own formulation of this 
saturation of attention is presented by the equations 

A, =y(l-A 1 -^f), (9) 

i 2 =y(l-^ 2 -^). (10) 

Where y is a suitably chosen constant. I mention that the bias which percept is realized 
first can be t aken i nto a ccount b y o ur a pproach a s w ell a s t he e ffect o f c hance e vents 
represented by fluctuating forces. Numerical solutions to the Equations (6)-(10) with the 
inclusion of bias is shown in Figure 3 where excellent agreement with experimental 
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results can be found by a suitable choice of the parameters. If the bias exceeds a critical 
value oscillations disappear and only one perception lasts forever. 



Figure 3. Upper part: Young woman or old woman? An example of an ambiguous figure showing oscillations 
of perception. Lower part: Oscillations of order parameters and for attention parameters X„X, for 
increasing bias (from top to bottom) 
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In the frame of phenomenological synergetics we have treated further phenomena such as 
hysteresis of perception (Figure 4,5). When one looks consecutively at a series of 
pictures, for example, in which a certain bias is slowly changed from one value to the 
other one (a famous example is provided by a man’s face that continuously goes over into 
the picture of a kneeling woman. A jump from the one perception to the other one occurs 
depending on the previously perceived pattern. If there is no bias, a chance event may 
determine which of the two possible interpretations is performed (in the terminology of 
synergetics symmetry breaking occurs). 


V(f) v(f) V(|) 



Figure 4. Description of hysteresis in terms of an order parameter the state of which is described by the position 
of a ball in a hilly landscape. Because of the change of the control parameter the landscape is deformed in one 
direction (upper part) and in the opposite direction Gower part). Note that for the same control parameter value 
the position of the ball that is the state of the order parameter differs because of history. 



Figure 5. Hysteresis in perception. The switch from the perception of a man’s face to that of a kneeling woman 
occurs at a different part of the total picture depending on the sequence of observations of the individual parts. 
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3 Decision Making as Pattern Recognition 

As I have shown elsewhere decision making can be interpreted as pattern recognition. 

Then the following analogies can be established: 

1. Unique perception -> unique decision. 

2. Two equivalent possibilities, symmetry breaking -> a small chance event may 
determine which of the two possible choices is made. 

3. Hysteresis: our perception depends on our previous perception in spite of the fact that 
objectively speaking the bias has changed. -> We make decisions similar to those 
corresponding to previous situations in spite of the fact that the situation has changed. 
I have called this phenomenon manager syndrome. When a manager has been 
successful in the past, he tends to make similar decisions in spite of the new situation. 

I want to stress that all these phenomena can be modeled at the order parameter level and 

in a number of cases still below it (cf. the final section). 


4 Health Care: Applications to Medicine and Psychology 

Synergetics may shed some new light on processes dealt with in medicine and psychology 
as I will demonstrate below by means of a more specific case. The general idea, however, 
is as follows: it is based on the concept of circular causality defined by the circle between 
order parameters and enslaved parts that in turn generate the order parameters. This 
implies the stability of a system governed by one or several order parameters. It can also 
be interpreted as the robustness of a system against deviations of one or several 
subsystems from their behavior prescribed by the slaving principle. In other words, when 
due to a fluctuation or another cause for a certain time a subsystem does not follow the 
prescribed behavior it will be pulled back to its “normal” behavior. There are two 
important conclusions, namely 

1. When the order parameter or a set of them represent a healthy state, we, at least 
intuitively, understand immediately that there is a self-healing capability of the 
system provided enough subsystems are still in the appropriate state. 


Table!. Error-Correction in reading. 


Spelling Errors 

Aoccdrnig to a rseearch at an Elingsh uinervtisy, it deosn’t mttaer in waht oredr the Itteers 
in a wrod are, the olny iprmoatnt tihng is that frist and Isat Itteer is at the rghit pclace. The 
rset can be a ttoal mses and you can sitll raed it wouthit porbelm. This is bcuseae we do not 
raed ervey Iteter by it slef but the word as a wlohe. 

Preosllnay I tinhk its cmolpete Bkolcols 
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2. New insights for therapy become possible if the order parameters represent some 
illness. The order parameter concept then implies that not just one component but 
several do not act normally. In this case we put the order parameter in analogy to the 
concept of a syndrome. This is not meant, however, only superficially, just by listing 
up the individual features of the enslaved parts. In the case of a syndrome we take 
this analogy seriously by saying that a syndrome is a dynamical state equivalent to 
that of an order parameter. 

In order to change an order parameter it is not sufficient to change the behavior of an 
individual part but to simultaneously change the behavior of a decisive number of parts so 
that the newly resulting order parameter can act self-consistently. At the same time if 
needed we also must change the appropriate control parameter values. Quite clearly 
specific subsystems are more important then others and, at least at the present stage, 
synergetics can give only qualitative hints for specific situations. While I believe that my 
conclusions are valid for a rather large range of phenomena in medicine, I want to 
concentrate somewhat more on these aspects in the field of psychotherapy. 

4.1. Can Synergetics Formalize Emotions? 

In order to achieve this goal we aim at quantitative registration according to the scheme: 
how often, how long, how strong is an objective or subjective “observable”. Subjectively 
these questions can be answered by introspection or objectively by a number of quantities 
which are physical, chemical quantities such as blood pressure, skin resistance, hormone 
levels, EEG, MEG, fMRI... registrations. External observations such as facial 
expressions (e.g. FAX-Ekman), movement patterns, posture, kind of speech (hastily, etc.). 
More recently we are aiming at automatic recognition by means of the synergetic 
computer dealing with the interpretation of facial expressions, and language recognition. 
The relationship between the order parameter (s) and the individual parts follows the 
usual scheme where the individual parts are in our case represented by feature vectors that 
may contain both subjective and objective components. As mentioned above we set a 
syndrome in analogy to an order parameter. An example of states of order parameters is 
provided by joy, sadness, fear... The order parameter concept implies associative 
completion as exemplified by the associative memory which can also lead to error 
correction. An important role is played by the interaction between emotion and cognition 
leading to the question which one acts as control parameter, which acts as order 
parameter, which enslaves what. In my interpretation emotion and cognition condition 
each other which is related but not identical with Ciompi’s concept of affect logics which 
is so-to-speak an order parameter that is related to affects on the one hand and logics on 
the other hand, whereby in the parlance of synergetics affects and logic play the role of 
enslaved subsystems. 

Let us discuss a few consequences for psychotherapy. A simple but rather instructive 
picture of the desired effect of intervention is as follows: we refer to Figure 4. On the left 
hand side the client is characterized by his/her order parameter in the left valley which is 
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an undesired situation, whereas the desired situation is indicated by the upper valley. How 
is it possible to bring the client from the left to the right position? A strategy offered by 
synergetics is as follows: by changing appropriate control parameters the landscape is 
deformed from the left hand side to the right hand side and then by further interventions 
the state of the person is brought from the left hand state to the right hand state. Note, 
however, that in the case of the right hand side in a number of cases external interventions 
are no more needed. The transition occurs by means of self-organization. In general the 
situation is more complicated because the state of the system must be described by means 
of a multi-dimensional picture, say, a two-dimensional landscape. Now destabilization 
must occur only in specific directions whereas the other directions must be kept stable. In 
addition in a number of cases, even in the newly destabilized state new more or less 
equivalent stable states (valleys) become accessible, some of which are still undesired. In 
such a case the symmetry-breaking must be done by external interventions. Let me be 
more specific. In order to destabilize a landscape and transform it to a new one in a 
number of cases antipsychotic drags may be administered and may be more efficient than 
verbal interventions because the latter act by learning via Hebbian synapses which is a 
slow process. However, once antipsychotic drags are administered, still the possibility of 
symmetric states arises, some of which are unwanted. In such case the newly evolving 
valleys must be equipped with meaning which can occur only via the psychological 
interventions. 


5 Synergetics in Management 

Synergetics as outlined in the first section as well as numerous examples treated at various 
levels provide us with a number of insights into management. Synergetics can be 
considered as a theory of indirect control rather than influencing the individual parts of a 
system directly and in a specific manner. Rather, the parts are controlled only in a global 
way. Nevertheless by means of self-organization highly ordered structures with interesting 
properties evolve. The example of the light source laser may serve as a nice paradigm for 
the effects of self-organization. The essential components of a laser are light emitting 
atoms or molecules. After being excited by some energy influx, e.g. an electric current, 
they emit light waves that in a usual lamp are entirely uncorrelated. When the energy 
input, that serves as control parameter, exceeds a critical value, a highly ordered light 
wave is generated via self-organization. Beyond this critical control parameter value, the 
efficiency of the system is changed abruptly (cf. Figures 6 and 7). Already this effect may 
be an incentive to study in more detail the mechanisms by which this efficiency is 
increased. First of all the appropriate atoms and molecules must be selected having 
specific properties. In other words, the laser self-organization is based on a number of 
specific properties of the components. They must emit their light waves strongly enough 
and be able to interact with the other atoms sufficiently strongly. Furthermore they must 
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be in an adequate surrounding, e.g. embedded in-between two parallel mirrors that reflect 
the generated light sufficiently often. 





Figure 6. Laser output versus energy input. Note the sharp transition at the laser threshold. 


efficiency 



Figure 7. The differential efficiency is defined by the size of the slope of the curve of Figure 6. Note the large 
jump. 

Even without going into any further mathematics one can draw a number of qualitative 
conclusions with respect to management. First of all the choice of capable coworkers is 
essential. They must be w illing toe ooperate i n a p reductive f ashion a nd t hey must b e 
brought in a stimulating environment. How can one attract in practice the appropriate 
coworkers? This requires a good standard for the life of their families such as schools, 
shopping centers and further amenities. Furthermore we must enhance the cooperation 
between coworkers within the company as well as outside of it. An important aspect of 
laser physics is the ability of the atoms and molecules to emit light spontaneously. This 
means that coworkers must be able to develop new ideas spontaneously. Correspondingly 
to the laser case there must be a transition period during which by brain sto rming new 
ideas are produced, checked against each other, realized by means of pilot projects and 
eventually selected (Figure 8). As the mathematical treatment of the generation of laser 
light shows, during the transition period there may be considerable fluctuations in the 
output (Figure 9). It takes a certain time until the coherent laser wave with its high 



167 


efficiency is established. This has quite evidently practical consequences also in 
management. Dining the transition period we must allow that errors are made and we 
must allow a for minimum time during which the new efficient system is established. I do 
not think that this is a superficial analogy but it points at an important issue, namely that 
in management we must observe fundamental laws of system dynamics. Careful planning 
surely can attempt to minimize errors or failures but in view of the complexity of modem 
systems there are limits. 



Figure 8. In the hilly landscape (lower part of Figure 1) the order parameter must roll down from the top to the 
bottom, whereby the disordered light of the lamp goes over into the fully ordered light of the laser with its high 
efficiency. Note that this transitions takes some specific time. 



Figure 9. Development of the fluctuations of laser light during the transition of the order parameter shown 
in Figure 8. 


Let me summarize my brief excursion into management. The basic concept of synergetics 
lies in the indirect steering of systems, i.e. the task of managers should be to generate 
general conditions under which self-organization becomes possible. This includes, of 
course, the appropriate provision of material and also immaterial resources, the 
establishment of corporate identity as the uppermost order parameter so that coworkers 



can identify themselves with the goals of the company, sufficient interaction between 
coworkers, flat hierarchies in order to avoid the information bottleneck that has been well- 
known especially in Eastern countries before the breakdown of the Soviet economic 
system, etc. 


6 Outlook 

In my article I have tried to indicate some developments of synergetics with respect to 
what is usually called “the soft sciences”. While synergetics started from physics and has 
found a profound mathematical basis, there is the tendency, even in the soft sciences, 
towards quantification and mathematical modeling. I think that synergetics may be of help 
along this way where starting from the level of semantic synergetics we may proceed to 
modeling by means of order parameters and eventually to a microscopic approach. 

A few hints may be useful. In psychology and psychiatry attempts at quantification 
have been successfully made in the past. More recently psychological and psychiatric 
processes have been analyzed in terms of time series. Analyses that are well-known to the 
science community dealing with fractals have been performed and predict the change of a 
mental state of a person. By means of quantitative analysis also the effects of the 
interaction between therapists and clients could be elucidated, especially by the work of 
Schiepek and coworkers (For references cf. [3]). Furthermore with respect to cognition, 
synergetics can provide us with new insights in particular by use of the order parameter 
concept in recognition processes of patterns and decision making. I think here the 
mathematization has progressed most, especially based on simple models of neurons as 
well as by use of computers and there is a vast literature which to referee here is beyond 
the scope of my paper. However, I want to indicate that concepts of synergetics have 
proven very useful in order to establish realistic models of neural networks and especially 
to cut through the very complicated equations. I just want to spend only a few words on 
these recent developments. The starting point is a rather realistic model of a neuron 
composed of its dendritic tree, its soma and its axon (Figure 10). The dendritic tree 
receives input signals from other neurons via synapses. These input signals are converted 
into dendritic currents that in turn within the soma are converted into voltage pulses that 
travel along the axon which then splits and makes contact to the dendrites of other 
neurons via synapses. This leads to the formulation of a pulse-coupled neural network in 
which for the first time the coupling between different neurons has been taken into 
account in a realistic fashion so that it has become possible to treat not only pulse- 
synchronization but also pattern recognition [4]. The key to an appropriate pattern 
recognition algorithm consists in a suitable transformation of the original microscopic 
equations into order parameter equations that directly refer to the patterns to be 
recognized. At the same time this time dependent mechanism of the establishment of 
order parameters on the one hand and the fading away of attention parameters on the 
other hand leads to a detailed theory of a finite window of perception that is perceived as 
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present. In this way the experimental findings of Poppel and others on a finite time 
window that is interpreted as present can be given an explanation. 



inputs from other outputs to other 

neurons neurons 

Figure 10. Model of a neuron with its dendrites and synapse (cf. text). By an appropriate choice of the synaptic 
strengths the corresponding neural network can model both pattern recognition as well as synchronization of 
the firings of neurons. 


In summary I may say that the methodology of synergetics seems to be capable of 
providing new insights and theoretical approaches to the life sciences. 
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Industrial Design is the field of developing physical solutions which might include products, 
vehicles, machinery, and even environments. For many years the industrial designers found 
inspiration by the symmetry and by the Euclidean shapes (e.g., polygons and polyhedra). The 
evolution of the technologies (from the hand-made to the Computerized Numeric Control) and the 
evolution of the materials (from glass to the polymer composites) have permitted to the designers to 
conceive shapes which pass the limits imposed by the Euclidean geometry. Modem design studies 
apply complex shapes based on the fractal geometry to create new kind of objects, realized in 
innovative materials. These objects sometimes mimic the complex shapes present in the nature. The 
aim of this paper is to describe an approach which introduces the connections between the Nature and 
some industrial design objects. Their complex shapes will be analysed using a fractal point of view. 


1 Introduction 

In the 20 th Century, there was an important transformation of our society from that of 
hand-made consumer goods realized and made by skilled craftsmen to one of mass- 
production with new materials and technologies. This transformation influenced the 
coming of the Industrial Design, which is a field of design that emerged in the late 1920s 
and early 1930s. The industrial designers can find inspiration by mathematics 
components. The Euclidean geometry, the symmetry, the golden ratio, the proportions, 
the curves (e.g., Bezier curves and B-splines) and the surfaces help the designers to create 
a canon of beauty [1, 2, 3, 4, 5]. We can analyse the industrial design objects using a 
different point of view, for example we can observe some complex or fractal 
components. In our analysis the complexity is not conceived as an area of chaos, but as 
an attempt to overcome the shapes imposed by the Euclidean geometry. The complexity 
is also connected to the fractal geometry. Fractal geometry describes the irregular shapes 
and it can occur in many different places in both Mathematics and elsewhere in Nature. 
Fractal objects are irregular in shape, and they are generally self-similar and independent 
of scale. There are several mathematical structures that are fractals; for instance the Julia 
set [6], the Koch snowflake [7], the Mandelbrot set [6] and the Lorenz attractor [8], 
Complexity and fractal geometry can inspire a new aesthetic sense [2, 9]. In the 1930, 
the American mathematician George Birkhoff (1884-1944) proposed a measure of beauty 
defined as: 

M = — <» 
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whereby M stands for “aesthetic measure” (or beauty), 0 for order and C for complexity. 
This measure could suggest the idea that beauty has something to do with order and 
complexity, but the Birkhoff s relationship is not used by the designers. 

Our studies followed these two questions: 

1. “Why the complex and fractal components are present in the industrial design 
objects?” 

2. “Can the complexity and the fractals help to create a new kind of industrial design 
objects?” 

To answer to the first question, it is important to consider that complex and fractal 
components are present in the industrial design to reproduce the Nature, which is visually 
complex and fractal-like [10, 11], In the industrial design this reproduction has 
influenced the development of materials, for example the introduction of the float glass, 
and new manufacturing techniques (for example the use of special laser). 

To answer to the second question our analysis has been organized in two parts: 

• To find the complex components connected to the natural shapes which have 
inspired some industrial design objects (e.g., turbulent motions of the water); 

• To observe the fractal components in the industrial design objects, in particular the 
self-similarity (for example in the Hadid’s objects). 

2 Complex Components In The Industrial Design Objects 

Industrial design find inspiration by the complexity of the Nature, and a new kind of 
industrial design objects were bom observing the complex components connected to the 
natural shapes and natural phenomena. The chaotic movement of the water has inspired 
the internationally renowned Welsh born designer, Ross Lovegrove. He is famed for his 
futuristic, organic minimalist designs and is one of this century’s leading international 
designers. Lovegrove’s passion for natural shapes, for example the water motion, 
influenced the creation of the visionary bottle for the spring water TY NANT (2001), 
shown figure 1. It has been produced using a plastic resin of the polyester family (PET: 
Polyethylene terephthalate). 



Figure 1. TY NANT bottle (2001) recalls the water motions. 
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The German lighting designer Ingo Maurer, that raised lighting design and lamps to a 
high art form, designed the lamp Paraguadi (1997), shown in figure 2, for Guadi’s Casa 
Bolines (1891-1892). Probably, he found inspiration for this lamp observing the turbulent 
motions of the smoke. 



Figure 2. The lamp Paraguadi (1997) by Maurer could be inspired to the turbulent motions of the smoke. 

The Italian architect and designer Alessandro Mendini cultivates a particular interest in 
neo-modem and contemporary design. His armchair Proust (1978) has a complex cover, 
shown in figure 3a, that recalls the Pollock’s painting Blue Poles: Number 11 (1952) 
which is manifestly fractal [9]. 



Figure 3. Proust (1978), realized by Mendrini for Studio Alchimia (Italy) a), shows a complex cover that recalls 
the Pollock’s painting Blue Poles: Number II (1952) which is fractal b). 

In 2001, Alberto Alessi, the third-generation owner of his family’s Italian 
manufacturing company, commissioned twenty-two internationally acclaimed architects 
to design the “Tea and Coffee Towers” project, a new landscape of objects designed by 
contemporary architects. This project combines the expression of architecture with the 
language of design [12]. Among those architects there are celebrity names such as Zaha 
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Hadid, Toyo Ito and Massimiliano Fuksas. All these designers use computerized 
techniques, fractal and non-linear geometry, and they have not a stereometric vision but a 
media vision of the space. They emphasize a communicative and existential fruition of 
the objects, obtained by original and visual components. For example. Iraqi-born British 
designer Zaha Hadid conceived a coffee-tea pot in 925/1000 silver for Alessi’s “Tea and 
Coffee Towers” project, shown in figure 8. It recalls futuristic and fractal shapes. Hadid 
considers her industrial design objects as an “architecture in small scale”, and she applies 
to design them the same fractal rules used in her architectural projects [9]. Observing 
figure 4, we can note the complexity of the shapes as a 3D puzzles, the single parts form 
the unity. This object exploits the combination and the contrast between the vertical and 
the horizontal parts [12,19]. 



Figure 4. Tea and coffee service (2003), realized by Hadid for Alessi exploits the combination and the 
contrast between the vertical and the horizontal parts. 


The Brazilian brothers Humberto and Fernando Campana design objects with complex 
geometry. They find your inspiration observing the shapes, particular complex, present in 
the Nature (e.g., trees, anemones and corals). For example, the citrus basket and the 
centrepiece bowl Blow up (2004), realized for Alessi in 18/10 stainless steel mirror 
polished, shown in figure 5a and 5b, and the chairs in the figures 6 and 7 were inspired 
by the natural shapes. 



a) b) 

Figure 5. Citrus basket Blow up (2004) a) and centrepiece bowl Blow up (2004) designed by Humberto and 
Fernando Campana for Alessi. 
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a) b) 

Figure 6. Anemone chair (2000) designed by Humberto and Fernando Campana for Edra (Italy) a), recalls the 
complex shapes present in the sea (Spirographis Spallanzani) b). 



Figure 7. Coral Chair (2003-2004) by Humberto and Fernando Campana for Edra a), mimics the branching 
structures of the corals b) which can be studied using a fractal approach [13]. 


3 Fractal Components In The Industrial Design Objects 

Fractal geometry is a mathematical theory that radically departs from traditional 
Euclidean geometry. It describes objects that are scale symmetric, or self-similar. This 
means that when such objects are magnified, their parts are seen as an exact resemblance 
to the whole, the property continues with the parts of the parts and so on to infinity. 
These shapes are called “fractals”, and they must maintain a rough, jagged quality at 
every scale at which an object can be examined. The nature and the characteristics of 
fractals are reflected in the word itself, coined by the Polish-bom French mathematician 
Benoit B. Mandelbrot from the Latin verb frangere, “to break”, and from the related 
adjective fractus that means “fragmented and irregular” [14, 15, 16, 17]. The acceptance 
of the word “fractal” was dated in 1975. Objects that are now called “fractals” were 
discovered and explored long before the word was coined (e.g., the Koch snowflake). A 
fractal object is self - similar if it has undergone a transformation whereby the 
dimensions of the structure were all modified by the same scaling factor. The new shape 
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may be smaller, larger, rotated, and/or translated, but its shape remains similar. “Similar” 
means that the relative proportions of the shapes’ sides and internal angles remain the 
same. The self-similarity is defined by Mandelbrot as follow: “When each piece of a 
shape is geometrically similar to the whole, both the shape and the cascade that generate 
it are called self-similar” [10, p. 34], Mandelbrot used the term “self-similar” for the first 
time in 1964, in an internal report at IBM, where he was doing research, and in the title 
of a 1965 paper. It is possible to demonstrate that the fractal shapes and the self-similarity 
were known to the artists in different cultures [18]. 

Industrial designers use the fractal geometry as a tool which permits to overcome the 
limit imposed by the Euclidean geometry. They can design new complex shapes to create 
a new kind of industrial design objects inspired by the Nature, based on the repetition in 
different scales, self-similarity, and on the “broken” symmetry [19]. For example, the 
American artist Danny Lame realized Shell (1988) for FIAM (Italy), shown in figure 8a. 
It is a coffee table with hand-sculptured float glass top of 15 millimetres thick. The base 
is made of five 12 millimetres thick hand-sculptured float glass elements, four of which 
curved. All the elements are kept together by stainless steel hardware. Lame’s coffee 
table is a clear example of a design object that mimics the fractal components present in 
the nature, in particular: the “broken” symmetry and the self-similarity present in the 
shells (figure 8b). 

Other industrial design object which has a fractal-like shape is the coffee table Papilio 
(1985) realized by Mendini for Zanotta (Italy). The table has two or three shelves in 8 
millimetres, shaped and hand-cut tempered glass. Legs in brushed, nickel plated steel, 
screwed onto stainless steel discs fixed to the glass. Figure 9a shows the three shelves 
version of this coffee table, and figure 9b illustrates the vision of the top that emphasizes 
the irregularity [19]. 

The repetition in different scales is also present in the Alessi’s “Tea and Coffee 
Towers” project. The architect and designer Tom Kovac, Australian of Slovene descent, 
realized for Alessi a tea and coffee service in double wall 925/1000 silver, shown in 
figure 10. Kovac is the Creative Design Director of Curvedigital a joint project between 
RMIT University and Melbourne Museum. He has explored the potential of new 
processes and developments in non standard manufacturing. The set of the objects that 
composes this tea and coffee service is a kind of code which activates a geometric 
progression, shown in figure 11. This progression opens new hypothesis in the design’s 
methodologies. The parts that form the set derive by correlation criteria that use the 
inference by the conceptual to the operative [12, 19]. Observing figure 11 we note that 
the same shape is repeated in four different scales. 

The self-similarity is also present in the cover of the chairs, an example, realized by 
the designer Paul Smith, is shown in figure 12a. The figure 12b illustrates a particular of 
a Mandelbrot set of the level a(c) for ceM, based on the Alfred Barten’s experiment [7]. 
The analogy between the figures 12a and 12b reveals that the designers’ creativity can 
find inspiration by the self-similar shapes connected to the fractal sets. 



177 



a) b) 

Figure 8. The coffee table Shell (1988) a) mimics the self-similar shapes present in the nature b). 




a) b) 

Figure 9. Coffee table Papilio (1985), by Mendini for Zanotta emphasizes the self-similarity a) the vision of 
the top shows the fractal components b). 



Figure 10. Tea and coffee service (2003) realized by Kovac for Alessi. 
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Figure 11. Tea and coffee service (2003) realized by Kovac for Alessi shows the same shape repeated in four 
different scales. 



a) b) 

Figure 12. The self-similarity is present in the cover of the chair designed by Smith a) the analogy with the 
fractal set b) is interesting. 

Natural and fractal patterns are used in the realisation of the industrial design objects. 
Frank O. Gehry created his playful Fish and Snake Lamps (1983-86) observing fishes’ 
and snakes’ skins that have self-similar pattern. Gehry designed the lamps that would 
emphasize the translucency of the laminate’s integral coloration. The serendipitous 
discovery of splintered patterns came after several failed attempts at a design in which 
one lamp was accidentally broken. Gehry translated the scale-like pattern of the jagged 
pieces into fish and snake forms. Another example of a lamp inspired by self-similarity 
presented in the nature is shown in figure 13. It is Styrene (2003) conceived by the British 
lighting designer Paul Cocksedge that creates visually spectacular and technically 
ingenious lights that celebrate the magical and transformative qualities of illumination. 
Styrene has an interesting analogy with the pangolin’s skin (in figure 13c). 
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c) 


Figure 13. Styrene (2003) by Cocksedge a) evidences a kind of self-similarity b) which is also present in the 
Pangolin’s skin c). 


4 Conclusions 

Complexity, fractals, nature, and industrial design have some interesting connections. 
The complexity paradigm is developing three different traditions: in the design fields 
(architecture, engineering, and industrial design), in the arts, and in the science [9, 18,20, 
21, 22]. This work describes only an approach where the complexity and the fractal 
geometry help the designers to create new kinds of industrial design objects, based on 
iterative processes. The fractal geometry is a potent language of complex visual form, in 
fact it reduces much of the staggering complexity present in nature to some very simple 
mathematical rules. The examples described in this work introduce the concept of non¬ 
linear design. In the Alessi’s “Tea and Coffee Towers” project, here described, there is an 
isomorphism between the complexity in architecture (complexity in the large scale) and 
the complexity in the industrial design (complexity in the small scale). All designers 
involved in this project worked on a dizzy change of scale and on some very different 
functions [12,19]. 

In this century, the joint evolutions of materials, manufacturing processes and design 
can create great products that have complex shapes [21,22,23,24,25,26], The complex 
components closely connected to the fractal geometry will define new CAD (Computer 
Aided Design) systems, and they will influence the industrial design in the next future. 
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In this paper we present a discrete stochastic model for laser-induced jet-chemical etch¬ 
ing in one and two spatial dimensions for the microstructuring of metals. Experimental 
observations show that depending upon the choice of system parameters either sur¬ 
face roughening occurs or the formation of periodic ripple structures. The results of 
kinetic Monte-Carlo simulations for the discrete model are compared to experimen¬ 
tal observations. The continuum limit taken for the discrete model leads to a modi¬ 
fied Kuramoto-Sivashinsky (KS) equation describing the evolution of the etching front. 
This type of equation is also characteristic for other erosion processes like water-jet 
cutting and can be considered as an order parameter equation. The spontaneous rip¬ 
ple formation can then be explained by the development of a front instability. Finite 
element simulations of the modified KS equation support the theoretical findings. 
Keywords: discrete stochastic model, laser-induced etching, Kuramoto-Sivashinsky equa¬ 
tion, finite elements 


1. Introduction 

Recently, considerable effort has been devoted to improve laser-induced processes 
for microstructuring of metals 1,2,3,4 . Laser-induced jet-chemical etching processes 
are of growing interest for microstructuring, because the low-power laser beam in 
combination with an etchant jet allows a highly localized material removal without 
imparting thermal or mechanical stresses on the workpiece. Metallic microparts 
of high surface quality are used for example as biomedical tools or as moulds for 
integrated optical microsystems. The laser-induced jet-chemical etching technique 
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has been successfully applied for the fabrication of superelastic microgrippers cut 
out of temperature-sensitive shape memory alloys 2 . However, under certain pro¬ 
cess conditions different surface morphologies are observed like roughening or the 
formation of unwanted ripples. These ripple structures may either be triggered by 
some external periodic forcing or they may be generated intrinsically due to the 
formation of an instability 5 . In order to avoid such parameter regimes and to opti¬ 
mize the process, a profound understanding of the basic mechanisms underlying the 
dynamics of the interacting thermochemical and hydrodynamical processes which 
lead to spontaneous pattern formation is necessary. 

Periodic patterns can be observed ubiquitously in nature and technical processes 
on a large range of scales. In nature, well known examples are the formation of cloud 
streets or the aeolian ripples in sandy deserts 15 . In technical systems, ripples occur 
during ion sputtering of amorphous surfaces 9 , in laser beam cutting 10 and water-jet 
cutting 14 ’ 5 or in laser ablation of transparent dielectrics 11 . Common to all these sys¬ 
tems is, that they are nonlinear open systems operating far from thermodynamical 
equilibrium in which at least two counteracting mechanisms exist, a destabilizing 
dynamics which is balanced by a stabilizing one. Since in laser-induced jet-chemical 
etching the interaction of thermodynamical, chemical and hydrodynamical processes 
is highly complex and not known in all details, we introduce here a phenomeno¬ 
logical discrete stochastic model, which is based on a competition of erosion and 
diffusion processes. Despite its simplicity the model captures essential features of 
the process like surface roughening and ripple formation. 

The article is organized as follows. In section 2 we give a short description of 
the principle scheme of the new laser-induced etching technique and present typi¬ 
cal surface morphologies which are observed experimentally. The one-dimensional 
discrete solid-on-solid model is introduced in section 3 together with results from 
kinetic Monte Carlo simulations. In section 4 we briefly review the main steps nec¬ 
essary to derive a continuous Langevin equation for the surface evolution of etched 
kerfs associated to the discrete model. A linear stability analysis throws light on 
the spontaneous formation of ripples. An extension of the discrete model to two 
spatial dimensions is presented in section 5 followed by finite element simulations 
of the corresponding deterministic evolution equation which has the form of a mod¬ 
ified Kuramoto-Sivashinsky equation. The results of the simulations are in good 
qualitative accordance with experimental observations. Finally, section 6 contains 
our conclusions and proposals for future work. 

2. The laser-induced jet-chemical etching technique 

Recently, a refined laser-induced wet chemical etching technique has been developed 
in which a relatively low-power laser beam is directed perpendicular to a workpiece 
together with a coaxial jet of fresh etchant liquid 2,4 . The metallic sample which 
has to be microstructured is submerged in the acid and mounted horizontally onto 
computer-controlled xy -stages allowing a relative movement of the sample with re- 
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spect to the laser beam. The absorbed light of the focussed laser beam thermally 
activates the surface of the workpiece, removes the passive layer and initiates etch¬ 
ing. The main advantages of this method are the high localization of material 
dissolution needed for microstucturing, the enhancement of chemical reactions due 
to the supply of fresh etchant and removal of reaction products by the etchant jet 
and the low thermal loading of the workpiece. Details of the experimental setup 
are described elsewhere 4 ’ 7 . 

In order to investigate the dynamics of the process, a wide variety of kerfs has 
been etched for varying process parameters 4 leading to rough surface morphologies 
or ripple structures 6 . Essential process parameters are found to be the laser power, 
scan velocity, concentration of etchant and jet velocity. The ripples may either 
be triggered by some external periodic forcing like the etchant pump or a control 
mechanism of the xy-stages 4 . Alternatively, they can be generated intrinsically due 
to a spontaneous formation of a front instability 4,7 . In fig.l a series of kerfs obtained 
for increasing scan velocities u is shown. For u = 2 fj,m/s a narrow uniformly etched 
kerf is obtained, which, however, turns suddenly for u = 3pm/s into periodic ripple 
structures. For increasing scan velocities u the wavelength of the ripples decreases 
until, for u = lOpra/s, a broad kerf without visible periodicity is obtained. 


I 

2jim/s 3jim/s 4|xm/s 5nm/s 6jim/s 7|im/s 8jxm/s 9*im/s 10|Xm/s 

Figure 1. Microscopic image of a series of kerfs (top view) etched with increasing scan velocity u 
(etchant 5M H3PO4, argon ion cw-laser with intensity 450 mW, jet velocity Vj = 1.59 m/s). 

3. The discrete stochastic solid-on-solid model 

Since we have only limited knowledge of the details of the dynamical processes 
involved in laser-induced jet-chemical etching, discrete models are very instruc¬ 
tive since they represent a link between theory and experiments and allow to dis¬ 
tinguish between essential ingredients of the interacting processes and secondary 
effects 8 . The discrete model which is presented in this section is a modification 
and adaptation of a discrete solid-on-solid model which was originally developed by 
Cuerno and coworkers to simulate morphologies of surfaces uniformly eroded by ion 
sputtering 12 . In this model periodic ripples occur at early stages at the onset of 
instability. Later, nonlinear effects lead to a degradation of ripple structures and a 




cross-over to a rough surface morphology. 

In contrast to uniform sputtering for laser-induced etching the laser beam is 
moved relative to the workpiece with constant velocity u thus activating chemical 
reactions on the surface only locally and during a characteristic time interval 



where d denotes the diameter of the thermally activated spot. Nevertheless, the 
basic mechanisms are similar to ion-sputtering. There are two counteracting pro¬ 
cesses, the removal of material due to etching which destabilizes the surface, and a 
diffusion which has a stabilizing effect. The basic idea for ripple formation is now 
the following. The scan velocity u has to be chosen small enough such that ripples 
have time enough to develop. On the other hand, the laser should leave the active 
zone early enough as not to degrade the ripple structure again. 

In brief, the model assumptions are the following. The laser beam thermally 
activates the surface, where the absorption rate depends upon the incident angle. 
The passive layer is then locally removed and wet-chemical etching starts. The 
etchant jet supplies fresh etchant and enhances the transport of heat and reaction 
products. In addition, multiple reflections within troughs lead to higher temper¬ 
atures in valleys than on hills. These reasons cause troughs (as long as they are 
not too deep) to be eroded faster than mounds, i.e. the etching rate depends upon 
the surface curvature. In this first model we neglect the formation of a diffusive 
(Nernst) layer as well as an additional heat source due to exothermic reactions. 



Figure 2. Discrete model for laser-induced jet-chemical etching. Schematic illustration of the 
curvature dependent rule a) for etching and b) for thermally activated diffusion. 

In the 1 + 1-dimensional case the model is defined on a lattice of rectangular 
cells with side lengths a and 6, see fig. 2. In lateral direction we choose L cells. 
The interface is assumed to be periodic with heights hi(t), i = 1,... ,L. Chemical 
etching and thermally activated diffusion locally take place in an active zone for 
which we assume a Gaussian profile with standard deviation a 

G(M)^-5=e- ( *-* o) W. (2) 

cry 2ir 

The center x 0 of the beam moves with constant feed velocity u. A cell at site i is 
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randomly selected and either subject to etching (with probability p) or to diffusion 
(with probability 1 — p). 

The probability for the particle to be removed by etching is then modelled as 
the product p e < = p C i Yi G*. Here p C j e [p 0 ,1] with 0 < po 1 is the curvature 
dependent probability for the cell to be removed and corresponds to the curvature 
of the etching front Ki = V 2 h,(l + (V/ij) 2 ) -3 / 2 at site i taken from an interval 
Ki e [-K m , K m j. The expression Vhi = (hj+i - ftj_i)/2a denotes the slope and 
V 2 hi = (/if_i — 2 hi + hi+i)/a? the discrete Laplacian. Yi is the absorptivity at site 
i depending upon the incident angle (pi = arctan(Vhj). In the model we assumed a 
function of the form Y t = yo + y\<p 2 + yip\- For slopes and curvatures mean values 
from three adjacents sites were chosen in order to suppress unphysical oscillations, 
see 7 6 for more details. While the rule for etching had to be modified and deviates 



40 80 120 160 200 



Figure 3. a) Kinetic Monte-Carlo simulations of the discrete model illustrating the evolution of 
ripple structures in the etching front, b) Comparison with experimentally measured etching fronts. 


in several aspects from Cuernos erosion rule, the diffusion rule is adopted from his 
model. A cell at site i is assumed to move to a randomly chosen nearest neighbour 
column with a hopping rate 


( 3 ) 


n = j/b 2 J2i = i^ ~ ^O 2 


where 


(4) 
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denotes the energy and A?A-*i±i is the energy difference between final and initial 
state of the move, J is a coupling constant and fJ denotes the inverse temperature 12 . 

Fig. 3 shows simulations of the discrete model for the following system param¬ 
eters: a — 2, b = 1, 0J = 5, u = 0.002a/step, po = 0.15, K m = 0.0825 b/a 2 . As 
initial condition a flat surface was chosen. The snapshots in fig. 3a illustrate how 
ripple structures evolve in the etching front due to the combined action of etching 
and diffusion. Little troughs in the forefront of the active zone are deepened during 
the characteristic dwell time AT given in eq. (1) while peaks are etched at smaller 
rates. For comparison, the evolution of an experimentally observed etching front is 
shown in fig. 3b. For the images the etching process was interrupted at sequential 
time steps and the surface topography was measured by a 3D-laser-focus scanner 4 . 
The good correspondence between simulations and experimental results strongly 
supports the presumption that the basic mechanisms for ripple formation are iden¬ 
tified in the discrete model. Fig. 4b shows simulated kerf profiles for different feed 



Figure 4. Simulations of the discrete model: a) ripple length vs. feed velocity, b) surface profiles 
for various feed velocities. 


velocities u = Vf of the laser beam. For the lowest velocity Vf = lx 10~ 6 a/step 
the etched kerf has the largest depth and shows only some small scale roughness 
without ripples. When the velocity is doubled ripples with high amplitude are 
formed spontaneously. For increasing scan speed the amplitude decreases again. 
For Vf = 32 x 10~ 6 a/step the beam is too fast to etch a kerf, i.e. the surface is 
only scratched. In Fig. 4a the ripple length is plotted as a function of the feed 
velocity. Like in the experiment, fig. 1, the ripple length decreases for increasing 
scan speed, i.e. the numerical simulations are qualitatively in good accordance with 
the experimental observations. 


4. The continuous Langevin equation 

In this section we summarize in short the steps which are necessary to perform a 
continuum limit on the basis of the discrete model which is strictly only valid in 
the small slope limit. A detailed description can be found in 6 . Starting from the 
rules for etching and diffusion a gain and loss type master equation is set up which 
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describes the evolution of the joint probability density P( H, t), i.e. the probability 
that the surface adopts the configuration H at time t 

MM = ^ W(U, H')P(H', t)-J2 W(U',U)P(U, t) (5) 

H' H' 

where W (H', H) is the transition rate per unit time to come from configuration 
H to IF. For this purpose the transition probability per unit time r for erosion 
and diffusion has to be expressed as a nonlinear function of surface heights hi(t) 
and its derivatives Vhj, V 2 hi,.... The master equation is then approximated by 
a Kramers-Moyal expansion. If the system fluctuations are not too large this ex¬ 
pansion can be truncated leading to the associated Fokker-Planck equation, see 16,6 . 
After regularization and coarse-graining we finally obtain a continuous Langevin 
equation for the evolution of the etching front. The explicit derivation of this equa¬ 
tion needs some calculus and can be found in 6 . Here we give only the result. In 
a coordinate system comoving with the laser beam with constant velocity u we 
obtain the continuous Langevin equation which has the form of a modified noisy 
Kuramoto-Sivashinsky equation which is typical for abrasive techniques 13,14 

^ + uVli = G(x) [no + iA7 2 /i - DS7 i h+ 

+A(Vh) 2 + ci V 2 h(Vh) 2 +...]+ r?(x, t). (6) 

The advective term on the left hand side arises from the transformation into a 
comoving coordinate system, G(x) denotes the profile of the active etching zone, vq 
is the mean velocity of the profile in vertical direction in the case of homogeneous 
etching ( G(x ) = 1). The Laplacian term with coefficient v < 0 acts like a negative 
surface tension and results from etching and D > 0 arises from thermally activated 
diffusion. The term A(Vh) 2 describes a lateral shrinking of the profile which is 
also due to etching. The nonlinear term with coefficient ci has a coarsening effect 
and r)(x, t) is a noise term. All coefficients as well as the noise correlations can be 
expressed explicitly in terms of the parameters of the discrete model. 

On the basis of the continuous model equation it is possible to understand 
the formation of ripples in the etching front. To this end we analyze the linear 
stability behaviour of the deterministic modified KS equation. Small plane wave 
perturbations of the form e ‘ JJ ^ t+lkx are superimposed to the stationary solution 
ho(x) = Cq + Cix of the homogeneous equation and lead to the following dispersion 
relation 

u(k) = -iku - vk 2 - Dk 4 . (7) 

For v > 0 and D > 0 the amplitude of the basic solution is always stable. However, 
for v < 0 and D > 0 plane waves are generated which are unstable for wave numbers 
0 < k < ko = \J\v\jD and stable for k > kg. The mode with the fastest growing 
amplitude has the wave number fc 0 = 2ny/2Dj\v\. The behaviour of the noisy KS 
equation is well studied 12 . In an early stage ripples are formed which are degraded 
at later stages and replaced by a rough surface structure. 



5. Extension to two spatial dimensions and Finite Element 
simulations 

The discrete model can be easily extended to two spatial dimensions x and y. The 
surface is defined on a 2D-lattice of quadratic cells of size a x a and represented by 
height values hij(t) at site i = 1,..., L x , j = 1 ,L y measured in units b. 

As for the ID model, we assume periodic boundary conditions. For the curvature 
dependent etching rule one has to assign a unique ’curvature’ value kJj to each 
lattice point (i,j), for which we propose the following expression 


i,j [i + (v*M 2 + (v y M 2 ] r 

Here, V x hij = (hi+ij — /h-ij)/2a denotes the slope in ^-direction, Vyhjj = 
(hij+i — hij-i)/2a the slope in y-direction and the Laplacian is approximated as 
V 2 hjj = (hi + ij + hij + 1 + hij-i + hi-ij — Ahij)/a?. Like in the one-dimensional 
case, we adopt mean values for kIj and V 2 hij in order to avoid spurious oscillations. 
The extension of the diffusion rule to the two dimensional case is straightforward. 
Instead of using eq.(4) the energy has to be determined as follows 

n = j/b 2 [( Kj - hi+u) 2 + (hij - hij +1 ) 2 ] . (9) 

Depending upon the choice of system parameters we obtain as in the one¬ 
dimensional case either kerfs with a rough surface or the formation of ripples. In 
fig. 5a the result of a simulation is presented where the following set of parameter 
values was chosen: a = 4, b = 1, (3J = 5, u = l.e -6 a/step, po = 0.15, K m = 
0.008 b/a 2 , a = 10 a and 50% of the laser intensity. The etched kerf clearly shows a 
ripple structure. 

In a next step we want to compare the results of simulations based on the 2D 
discrete model to numerical solutions of the deterministic noiseless modified KS 
equation in 2 spatial dimensions using finite elements (FE). To be able to test the 
FE code, a slightly modified KS equation was used which has been proposed for 
waterjet cutting 14 ’ 5 . This equation differs only in the nonlinear yield function from 
eq. (6), showing also ripples for certain parameter ranges. 

W = we ‘’ ?/! " I (TTW + ' ,V2 '* + ' 5V4, ‘)- <I0> 

where xi = x — ut denotes the instantaneous position of the center of the waterjet 
moving with constant velocity u. 

In the following, we briefly summarize the main steps leading to a FE formulation 
for a parabolic evolution equation of the form 

V 2 h, V 4 h) (11) 

where N can be any physically reasonable nonlinear function and the order of the 
highest derivative is 2 m = 4. For the Galerkin FE method 18,17 eq. (11) is written 
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in the weak form 

T = J ^ 3h - N(Vh, V 2 h, V 4 /i)| 6<pdx = 0, (12) 

where Sip denotes a test function. A desirable feature of the Galerkin method is 
that applying Green’s theorem m times the order of the highest derivative can be 
reduced to m, in the case of eq. (12) to m = 2. The solution h is approximated by 
suitable piecewise polynomial trial functions. A necessary condition for convergence 
to the exact solution requires a complete polynomial of order m = 2. In addition, 
the elements must be conforming which means that the trial functions and their 
first m — 1 derivatives are required to be continuous across element boundaries 18 . 
In 2D, both conditions are met if we apply two times partial integration to the 
term with the highest derivative and choose triangular elements with trial and test 
functions which are complete polynomials of 5th order. For the time integration of 
the resulting nonlinear system of equations the unconditional stable Crank-Nicolson 
method is used while nonlinear terms are treated with Newton iterations 17 . 



Figure 5. Profiles of kerfs for increasing feed velocities obtained from (a) discrete model simula¬ 
tions and (b) finite element simulations. 

Fig. 5b shows a FE simulation of eq. (10) with a flat surface as initial condition 
and the system parameters N = 1.5, a = —1.8, (3 = —3.283, a = 3, u = 0.555. 
Regular periodic ripples of wave length A = 14 are formed under these conditions. 
The pattern is in close correspondence to the discrete model simulation for laser- 
induces etching shown in fig. 5a. It can be concluded that due to the localized 
ablation process the specific form of the nonlinear terms is not essential for the 
structure formation. The linear stability analysis has shown that the interplay of 
the counteracting terms V 2 /i and V 4 /t is responsible for the formation of periodic 
patterns. 

6. Conclusions 

In this study we have presented a simple discrete stochastic model for one and two 
spatial dimensions for laser induced jet-chemical etching. Numerical simulations 
have shown that depending upon the system parameters some essential features like 
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surface roughening and ripple formation can be reproduced with this model. In the 
continuum limit this model corresponds to a noisy modified Kuramoto-Sivashinsky 
equation. A linear stability analysis can explain the spontaneous formation of peri¬ 
odic structures. A comparison of 2D simulations of the discrete model and for finite 
element simulations of a deterministic modified Kuramoto-Sivashinsky for waterjet 
cutting are in close accordance. In a next step, FE simulations for the deterministic 
KS equation derived for laser-induced etching, eq. (6), will be compared to discrete 
model results. Further, refinements of the discrete model are planned like the in¬ 
clusion of a diffusive layer and the additional heat source which arises in the case 
of exothermic reactions. 
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Bernd Lehle, Alexei Kouzmitchev, Andreas Stephen, Simeon Metev and Ferenc 
Kun. 

References 

1. R. Nowak and S. Metev, A.Phys. A 63,133 (1996). 

2. A. Stephen, G. Sepold, S. Metev and F. Yollertsen, J. Mat. Proc. Tech. 149 536 (2004). 

3. P.T. Pajak, A.K.M. De Silva, J.A. McGeough and D.K.Harrison, J. Mat. Proc. Tech. 
149 512 (2004). 

4. T.J. Rabbow, A. Mora, M. Haase and P.J. Plath, to be published in Int. J. Bif. Chaos. 

5. G. Radons, T. Ditzinger, R. Friedrich, A. Henning, A. Kouzmichev and E.Westkamper, 
in: Nonlinear Dynamics of Production Systems, eds. G. Radons and R. Neugebauer, 
WILEY-VCH Verlag Weinheim 575-592 (2004). 

6. A. Mora, T. Rabbow, B. Lehle, P.J. Plath and M. Haase, in: Fractals in Engineering, 
New trends in theory and applications, eds. E. Lutton, J. Levy-Vehel, Springer 125-139 
(2005). 

7. A. Mora, M. Haase, T. Rabbow and P.J. Plath, http://arxiv.org/abs/cond- 
mat/0503093 and submitted to Phys. Rev. E (2005). 

8. A.-L. Barabasi, H.E. Stanley: Fractal Concepts an Surface Growth, Cambridge Univ. 
Press (1995). 

9. D.J. Barber, F.C. Frank, M. Moss, J.W. Steeds, I.S.T. Tsong, J. Mater. Sci. 8 1030 
(1973). 

10. W. Schulz, V. Kostrykin, M. Niessen, J. Michel, D. Petring, E.W. Kreutz and 
R. Poprawe, J. Phys. D: Appl. Phys 32 1219 (1999). 

11. I. Georgescu, M. Bestehorn, arXiv:cond-mat/0411244 (2004). 

12. R. Cuerno, H.A. Makse, S. Tomassone, S.T. Harrington and H.E. Stanley, Phys. Rev. 
Lett. 75, 4464-4467 (1995). 

13. K.B. Lauritsen, R. Cuerno, H.A. Makse, Phys. Rev. E 54, 3577-3580 (1996). 

14. R. Friedrich, G. Radons, T. Ditzinger, A. Henning, Phys. Rev. Lett. 85, 4884-4887 

(2000). 

15. H. Haken, Synergetics, Introduction and Advanced Topics, Springer, Berlin (2004). 

16. H. Risken, The Fokker-Planck equation, Springer, Berlin (1996). 

17. H. Parisch, Losung der modifizierten Kuramoto-Sivashinsky-Gleichung mit Finiten 
Elementen am Beispiel des Wasserstrahlschneidens, Internal Report 2005/1, ISD, Uni- 
versitiit Stuttgart. 

18. C. A. Fletcher, Computational Galerkin Methods, Springer, New York (1984). 



FRACTAL PROPERTIES OF SOME MACHINED SURFACES 


T. R. THOMAS 

School of Business and Engineering, Halmstad University, PO Box 823, SE-30118 Halmstad, 
Sweden 

B.-G. ROSEN 

School of Business and Engineering, Halmstad University, PO Box 823, SE-30118 Halmstad, 
Sweden 


Many surface profiles are self-affine fractals defined by fractal dimension D and topothesy A. 
Traditionally these parameters are derived laboriously from the slope and intercept of the profile’s 
structure function. Recently a quicker and more convenient derivation from standard roughness 
parameters has been suggested. Based on this derivation, it is shown that D and A depend on two 
dimensionless numbers: the ratio of the mean peak spacing to the rms roughness, and the ratio of the 
mean local peak spacing to the sampling interval. Using this approach, values of D and A are 
calculated for 125 profiles produced by polishing, plateau honing and various single-point 
machining processes. Different processes are shown to occupy different regions in D-A space, and 
polished surfaces show a relationship between D and A which is independent of the surface 
material. 


1 Introduction 

Almost as soon as fractal mathematics became available, the possibilities became 
apparent of its application to various fields of mechanical engineering, including contact 
mechanics [1,2], heat transfer [3,4], friction and adhesion [5,6] and wear [7,8]. In the 
related field of manufacturing and production engineering it has been applied to sheet 
metal rolling and forming [9,10], but a more important area of fractal application is in 
engineering metrology, specifically the study of surface roughness. 

Ever since Whitehouse [11] drew attention to the “parameter rash”, the proliferation 
of ill-defined and often redundant or tautologous parameters used to describe surface 
roughness, production engineers have been seeking the Holy Grail, a minimum set of 
parameters, independent of measurement artefacts such as filter cutoffs and sampling 
interval, which is both necessary and sufficient completely to define the roughness of a 
surface. One approach to this has been to represent machined surfaces as self-similar 
fractals, as it was early recognized that die topography of many technical surfaces was 
fractal in nature. Brown and his co-workers (e.g. [12]) have done much to raise 
awareness of the possibilities of fractals in the engineering community, and at least one 
national roughness standard now incorporates fractal dimension. Many proprietary 
software packages for the characterisation of surface roughness now offer the possibility 
of calculating the fractal dimension. 

However, fractal dimension on its own may not be sufficient. Whereas self-similar 
fractals are space-filling curves where for any point in the x-y plane there may be multiple 


191 



192 


values of the argument z, measurements of real surfaces must always be single-valued, 
that is there can only be one measurement of height for a given point on the surface. This 
is not to say that the surface itself is necessarily single-valued, simply that real measuring 
instruments can only show it as such. To preserve the same appearance at any scale, 
therefore, the surface, as it is magnified on a vertical scale by some numerical factor k, 
must be stretched on a horizontal scale by a scaling factor k H , where H is the so-called 
Hurst exponent [14] related to the fractal dimension D. Such surfaces are termed self- 
affine [14,15], and their self-affinity is usually characterized by their topothesy A [13], a 
parameter with dimensions of length which depends on the Hurst exponent and hence on 
the fractal dimension. 

The fractal dimension D and topothesy are usually obtained from the structure 
function (SF) [14], The SF is the expected value of the squared difference in heights 
between points on the surface separated by a delay r. 

S(r) = <[z(x)-z(x+T)f> 

and is closely related to the better-known autocovariance function (ACVF) R(r) by 

S (t) = 2[R(0)-R(t)] = -t*R"(0) (1) 

Then it has been shown [14,15] that 

S(r) = A 20 ' 2 ^ (2) 

To obtain fractal parameters from Eqn. 2, it has formerly been necessary first to 
compute the SF from raw profile data and then to obtain the slope and intercept of the 
logarithmic plot (Figure 1) [15]. This is time-consuming and requires the writing of 
some code, as no proprietary software currently offers the structure function. As a result, 
few numerical values of the topothesy of machined surfaces are available in the literature. 



Figure 1. Obtaining D and A from the slope and intercept of a logarithmic plot of the structure function [15], 
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However, Whitehouse [16] has pointed out that the necessary properties of the 
structure function can be expressed in terms of the derivatives of the ACVF at the origin, 
which in turn can be obtained from parameters readily available in current surface 
standards. In this paper we apply Whitehouse’s results to some real profiles and give 
examples of the fractal parameters thus calculated. 


2 Derivation of fractal parameters 

Whitehouse defines a curvistructure Junction C(r) as the expected value of the three-point 
curvature at a point x: 

C(r) = <[2z(x)-z(x+t)-z(x-t)?> 


By analogy with Eqn. 1, 

C(r) = 2[S(0) - S(r)] = t 4 R>) (3) 

where R^O) is the 4 th derivative of the ACVF at the origin. 

Now the local peak density d p can be expressed in terms of derivatives of the ACVF 
at the origin (e.g. [15]): 




J_ R^O) 
2k\-R''(0) 


( 4 ) 


With some manipulation of Eqns. 1-4, the fractal dimension can be related to the 
local peak density and the sampling interval by 

d=-^~yl4D 2 -6D + 2 (5) 

2ttc 


The local peak density is just the reciprocal of the mean local peak spacing S, so 
finally 

{IntiSf = 4D 2 - 6£> + 2 (6) 

The fractal dimension thus depends only on the dimensionless ratio Sir (Figure 2). 
Fractal dimension is high when the local peaks are closely spaced relative to the sampling 
interval, i.e. the profile contains a substantial short-wavelength component. As the 
distance between local peaks increases, i.e. there are fewer short-wavelength features, the 
fractal dimension tends asymptotically to unity. 
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Figure 2. Relationship between fractal dimension D and dimensionless mean local peak spacing Sir according 
to Eqn. 6. 


Similarly, the zero-crossing density d 0 can be expressed in terms of derivatives of the 
ACVF: 


do 


I I - R"(0) 
xy r(0) 


( 7 ) 


Combining this with Eqns. 1 and 2, and recalling that R(0) is by definition the square of 
the rms roughness Rq, 

A = r(d 0 Rq 7t) 1/[ZM) 

(Whitehouse obtains a slightly different result for A). But d 0 is the reciprocal of the 
mean peak spacing Sm so finally 


A 

T 



( 8 ) 


Thus the dependency of the topothesy on measurable profile properties is described 
by a relationship between three dimensionless numbers: the fractal dimension, the ratio of 
the topothesy to the sampling interval, and the ratio of the mean peak spacing to the rms 
roughness (Figure 3). This last ratio, being the ratio of a texture parameter to an 
amplitude parameter, may perhaps be thought of as some kind of average reciprocal slope 
of peaks. 
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Figure 3. Relationship between fractal dimension D, dimensionless mean peak spacing Sm/Rq and 
dimensionless topothesy Air, according to Eqn. 8. 

So the estimation of the two fractal parameters reduces to a simple calculation from 
three existing and widely used roughness parameters, Rq, S and Sm, defined in current 
technical standards, together with the sampling interval z. No special computation of any 
of these parameters should be required as they are implemented in many commercial 
software packages. 

3 Results and discussion 

A number of surfaces were selected from a database of 3D height measurements built up 
over many years. The original measurements were made on areas of up to 1.5 mm x 
1.5 mm of various machined surfaces at sampling intervals of between 0.1 nm and 
3.4 pm, using several different models of scanning interferometer. Finishing processes 
included polishing, plateau honing, and various single-point machining techniques 
including milling, turning, reaming and shaping. Ensemble average values of Rq, S and 
Sm were obtained from up to 480 parallel profiles on each surface using proprietary 
software, and from these values fractal dimensions and topothesies were calculated by 
means of Eqns. 6 and 8 (Figure 4). 

Fractal dimensions range from 1.1 to nearly 1.8, a wider range than predicted by 
Kant [17], who suggested that most real surfaces would have values of D in a narrow 
range around D= 1.5. The range of values of topothesy is even wider, from ~1 pm for 
plateau-honed surfaces down to 10" 2 ° pm for some of the polished surfaces. Considered 
as a length, the latter figure is rather embarrassing, being many orders of magnitude 
smaller than the diameter of an electron (~10' 9 pm). Other workers who have attempted 
to measure the topothesy have obtained a similarly wide range of results, as reviewed by 
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Arutyunov [18]. This may arise from Berry’s [19] definition of topothesy as the spacing 
of pairs of points on the surface at which the rms slope will be one radian. Such a slope 
may be plausible for a geomorphological surface measured on a millimeter scale [18] but 
is an impossibly high value for any machined surface. Thus, the very low values of 
topothesy here reported may simply emphasise that some polished surfaces are extremely 
flat. 

It appears that fractal parameters may be of some use to classify finishing processes. 
Single-point, polished and plateau-honed surfaces seem to occupy separate and 
reasonably well-defined areas in D-A space. Polished surfaces, which include both steel 
and ceramic surfaces, seem to show a relationship between D and A which is independent 
of the polished material. 



1 1.2 1.4 1.6 1.8 

D 


Figure 4. Calculations of fractal dimension and topothesy (in pm) from measurements on 125 profiles. 


4 Conclusions 

The method proposed by Whitehouse for the calculation of fractal parameters shows a 
fundamental relationship between these parameters and dimensionless ratios of standard 
roughness parameters. The method is able to yield a large number of results quickly and 
conveniently. The numerical values so obtained are self-consistent. In the case of 
topothesy, this is believed to be the largest collection of values so far presented for 
technical surfaces, and the numerical values are consistent with values previously 
reported in the literature. Plots of D against A apparently are able to distinguish between 
different finishing processes. For polished surfaces, there appears to be a relationship 
between D and A which is independent of the polished material. 
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For workers who do not have access to modem measuring equipment and software, 
there is an even simpler, though laborious, way of applying this method. If a legacy 
stylus instrument is available which will measure the average roughness Ra, the rms 
roughness Rq may be estimated within the li mi ts of measurement uncertainty for the 
majority of profiles by assuming the sinusoidal relationship Ra = 0.9 Rq [20], The peak 
and zero-crossing densities can be counted manually from an analogue recording of the 
profile itself. In this case the sampling interval should be taken as the low-pass filter 
cutoff or twice the stylus width, whichever is the greater. 

Not all machined surfaces are fractal, and not all fractal surfaces keep the same 
values of fractal parameters throughout their measured range. Whitehouse [16] has 
further suggested that simple measurements of the kind described in this paper, if made at 
two different sampling intervals sufficiently far apart, can quickly establish the fractality 
of a profile or the existence of multifractality. 

All the above arguments apply only to 2D measurements. Extending Whitehouse’s 
method from profiles to surfaces is not straightforward. As we have shown elsewhere 
[21], both the topothesy and the fractal dimension of profiles on an anisotropic surface 
vary with the direction of measurement, and it will be for the future to determine how or 
even whether a 3D topothesy can be defined. 
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Results of computational modeling are synthesized for the forms of crystals growing in 
undercooled liquid. Solidification patterns are analyzed as a result of the first-order 
phase transformation controlled by the heat diffusion, atomic kinetics, and interfacial 
anisotropy. It is shown that fractal patterns are observed at a vanishing anisotropy of 
surface energy and atomic kinetics of the solid-liquid interface. Simulated patterns are 
summarized into morphological spectrum which is considered as a sequence of growth 
shapes that forms versus undercooling (deviation from thermodynamic equilibrium) in 
solidifying system. A diagram “complexity of growth forms” as a function of “microscopic 
disorder and deviation from equilibrium” is presented. 


1. Introduction 

How complex solidification microstructures evolve versus deviation from equilibrium 
is one of the intriguing questions of modern theory of solidification. Answering this 
question for the concrete system allows one to give systematization of microstruc¬ 
tures and find the morphological transitions among them *. In systematization 
of solidification growth-morphologies, a progress has been reached with using ex¬ 
perimental, theoretical and computational modeling (see, e.g., monographs 2,3 and 
collected papers 4 ). Recent experimental findings and theoretical description of 
formation of various growth microstructures are presented in overviews 5 . 

In addition to understanding of originating of randomly branched patterns in 
diffusion-limited aggregation 6 , qualitative understanding of the development of 
solidification patterns has been made after introducing interfacial anisotropy of 
surface energy into the models of crystal growth 7 . Anisotropy provides small 
singular perturbation on the solid-liquid interface and leads to the selection problem 
of solidification patterns, especially, to cellular and dendritic patterns (see overviews 
8 and refernces therein). The result of interfacial dynamics, leading to the various 
cellular, fractal and dendritic patterns, has been represented by Ben-Jacob 9 in a 


‘This work is supported by the German Research Foundation (DFG - Deutsche Forschungsge- 
meinschaft) under the project No. HE 1601/13. 
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form of morphological spectrum dependent on interfacial anisotropy and deviation 
from equilibrium in Laplacian growth. 

In the present paper we consider a spectrum of solidification patterns as a funtion 
of initial undercooling 


A = 


T m ~T 0 

Tq 


(1) 


where Tm is the melting point temperature (or equilibrium temperature of solid¬ 
ification); Too is the temperature of the liquid phase far from the interface; Tq is 
the unit of undercooling (adiabatic temperature of solidification) defined by relation 
Tq — Q/k, Q and k are the latent heat of solidification and specific heat per unit 
volume, respectively. Dimensionless undercooling A may be considered as a param¬ 
eter characterising deviation from thermodynamic equilibrium. It is chosen as the 
main parameter describing morphological changes of crystal patterns. Therefore, 
we present results of computational modeling of solidifying patterns depending on 
undercooling and at a given fixed anisotropy of interfacial properties such as interfa¬ 
cial energy and interfacial kinetics of crystal growth. A transition to fractals in this 
morphological spectrum is shown as a result of vanishing anisotropy of interfacial 
properties. Finally, we analyze complexity of interfacial patterns (fractals and den¬ 
drites) and a transition to homogeneous (non-branched) patterns versus disorder in 
a solidifying system and deviation from thermodynamic equilibrium. 


2. The model 


In order to obtain the morphological spectrum of patterns, we have used the phase- 
field model for solidification. In contrast to the classical sharp-interface model in 
which one assumes the zero thickness of the phase interface, the phase-field model 
introduces a new variable, the phase-field $, and replaces the sharp interface by a 
diffuse interface. The phase-field $ has a constant value in phases, e.g. $ = 1 for 
initially unstable phase which is transforming into the final phase with $ = -1. 
Between these phases, in the interfacial region, the phase field, $, changes steeply 
but smoothly from -1 to 1. It allows one to avoid the explicit interface tracking 
and locate the interface at $ = 0. Consequently, the phase-field $ is considered as 
an order parameter which is introduced to describe the moving interfacial boundary 
between initially unstable phase and final phase. 

We use the phase-field model via ”thin-interface” analysis developed by Karma 
and Rappel 10,11 and extended by Bragard et al. 12 for both small and highest 
undercooling in a pure system. In this analysis the interface thickness W is as¬ 
sumed small compared to the scale of the crystal pattern but not smaller than the 
microscopic capillary length do- 

The main governing equations of the phase-field model are written as 
- energy conservation 


f=- v 2 r+ vS- :r « vs 


(2) 
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- phase-field, evolution 

T(n)|^ = V.(W' 2 (ri)«.) 


+ z 




( 3 ) 


where T is the temperature, f is the radius-vector of a point with the Cartesian coor¬ 
dinates (x, y,z),t is the time, a is the thermal diffusivity, and the phenomenological 
free energy F is defined by 

F(T, *) = /(*) + X{T ~ Tm) 9 ($). (4) 

t Q 

Eq. (4) includes the double-well function /($) = -4> 2 /2+$ 4 /4 and the odd function 
g($) = $ - 2<f> 3 /3 + 4> s /5 itself, and the form of free energy F is constructed in 
such a way that a tilt A of an energetic well controls the coupling between the fields 
of T and 4>. 

The time r(n) of the phase-field kinetics and the thickness W (n) of the 
anisotropic interface are given by 

W(n) = W 0 a c (n), (5) 

where To is the time-scale for the phase-field kinetics, Wo is the parameter of the 
interface thickness, do is the microscopic capillary length, and n is the normal vector 
to the interface. The second term in square brackets of Eq. (5) for r(n) defines a 
correction for the “thin-interface” asymptotics with adopting a constant a .2 ~ 0.6267 
12 in comparison with the sharp-interface analysis. The functions a c (n) and a,k(n) 
of interfacial anisotropy are described by 

- the anisotropy of interfacial energy 

a c {n) = ^ = (1 - 3e ‘) l 1 + + n * + n ' } ] ’ (6) 

where 7 (ft) is the surface energy dependent on the normal vector n to the interface, 
70 is the mean value of the interfacial energy along the interface, and e c is the 
anisotropy parameter, 

- the anisotropy of kinetics of atomic attachment to the interface 

where ft (it) is the kinetic coefficient dependent on the normal vector n to the inter¬ 
face, Po is the averaged kinetic coefficient along the interface, and £k is the kinetic 
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anisotropy parameter. In Eqs. (5)-(7), the normal vector n = n(n x ,n y ,n z ) has the 
components defined by the gradients of the phase-field as follows 

_4 i _4 i _4 (dt/dx)* + (0*/0J,) 4 + (d*/dz)< 

n x + n v + n z = -j^l 4 -. (8) 



Figure 1. (a) Realistic dendrite grown from undercooled metallic melt and visualized with using 

electronic microscope upon solidification, (b) 3D modeled dendritic pattern of nickel crystal grown 
from undercooled melt in the phase-field model (2)-(10). 


As it has been theoretically proved by Brener and Temkin and experimentally 
verified by Bisang and Bilgram 14 thermal fluctuations are necessary to be taken into 
account for observed realistic shape of crystals with the interface sidebranching. To 
model the branched patterns, the random variables q{f, t) and 9(r, t) for description 
of the thermodynamic noise existing in solidifying systems have been introduced into 
equations (2) and (3), respectively. The variables were chosen in consistency with 
the results of Refs. 11,13 in which analysis of stochastic forces is developed for the 
anisotropic phase-field models. According to Karma and Rappel 11 , the noise is 
added by introducing the non-conserved random variable 9(r, t) for the phase-field 
and the vector of conserved thermal noise to be uncorrelated in space and 

time and obeying Gaussian distributions. The variables have the variances dictated 
by the fluctuation-dissipation theorem which are described by 
{0(?,t)9{f ',*)> = 2A dlF exp 6(f-r')6(t - t'), 


(Q m {rMr',t)) = 2 Dd*F exp 6 mn 6(f- -1'). (9) 


In Eq. (9), F exp is a single dimensionless experimental parameter which represents 
the magnitude of the noise existing in experiments and is defined by the following 
relation 


F ei 


T Q Qd*’ 


where fc/j is the Boltzmann constant. 


( 10 ) 
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3. Morphological spectrum 

The phase-field model (2)-(10) allows one to model quantitatively the dendritic 
growth and morphological transformations among the growth forms with the ac¬ 
ceptance of material constants obtained experimentally 15 . This system has been 
resolved numerically on the uniform numerical grid with application of the explicit 
numerical scheme for simultaneous solution of the heat equation (2) and phase- 
field equation (3). Initial and boundary conditions, the numerical parameters and 
constants of material applicable to pure nickel are described in Ref. 15 . 



Figure 2. Simulated morphologies for different initial undercoolings: (a) A = 0.15; (b) A = 0.25; 
(c) A = 0.50; (d) A = 0.75; (e) A = 0.85; (f) A = 1.01. The patterns were modeled on a numerical 
grid of size 450 3 . 

Phase-field modeling of crystal growth in liquids showed good reproduction of 
crystalline structure in comparison with a structure of realistic dendrites grown from 
the metallic melt. Figure 1 represents the result of modeled dendrite grown from 
nickel melt in comparison with dendritic pattern observed in electronic microscopy 
upon solidification of undercooled melt. It can be seen that the phase field model 
(2)-(10) gives realistic results of modeling in comparison with experimental observa¬ 
tions. One of the interesting features of dendritic growth may be outlined from this 
computation: the secondary branches on the main stems of the modeled dendrite 
(1(b)) are the result of stochastic noise described by Eqs. (9)-(10). The main stems 
are result of the existence of the preferable crystallographic directions for growth 
(for nickel crystals, these give the four-fold symmetry) at a given undercooling. In 
contrast, the surfaces of the main developed stems become morphologically unstable 
and give a secondary branches in a presence of stochastic noise. 
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In the numerical simulations, we obtained a morphological spectrum of dif¬ 
ferent interfacial crystal structures for a range of dimensionless undercoolings 
A = 0.15,..., 1.1. The results are presented in Fig. 2 and show a transition from 
smooth non-branched crystals at small undercoolings A <0.15 to dendritic patterns 
at intermediate undercoolings 0.15 < A < 1.0 changing again to non-branched crys¬ 
tals at high undercoolings A > 1.01. Within the range of intermediate undercool¬ 
ings, the shape of the dendrites is dictated by preferred crystallographic directions. 
For the case of nickel, the dendrites grow in the < 100 >-direction even though 
both physical anisotropies given by Eqs. (6)-(7) act during growth simultaneously. 

The role of anisotropy for selecting and stabilizing dendritic structures has been 
reviewed in Refs. 8 . In the presence of both, surface energy and kinetic anisotropy, a 
stable growth mode of dendrites is found for arbitrary undercoolings. As classified in 
Refs. 8,ie , the so-called surface tension needle crystals occur at small and moderate 
undercoolings. At higher undercoolings, kinetic needle crystals grow due to the 
anisotropy of the atomic kinetics. As soon as one of the anisotropies vanishes, one 
may expect a degeneration of the stable dendritic growth within the considered 
range of undercoolings. 



Figure 3. Dendritic and fractal patterns in three-dimensional phase-field modeling. Simulated 
morphologies of crystals are obtained for: (a) dendrite at A = 0.95 and with finite values of 
anisotropy strengths e c and s* ; (b) fractal at A = 0.95 and with zero values of anisotropy 
strengths: e e = e* = 0 in Eqs. (6)-(7). Patterns were modeled on a numerical grid of size 550 3 . 


4. Fractals in crystal growth 

A transition from regular dendritic patterns to fractals is observed for vanishing 
anisotropy of crystal growth. To give evidence of this idea, we simulated a growth 
of a planar interface without stochastic noise but with a small perturbation on it 
(as an initial seed for instability). The results of modeling for growth both with and 
without crystalline anisotropy are presented in Fig. 3. As shown in Fig. 3(b), the 
branched crystals of fractal type develop for zero anisotropies of the surface energy 
e c = 0 and of the kinetic coefficient e*. = 0 in Eqs. (6)-(7). 

Due to the absence of crystalline anisotropy, tips of branches split and the new 
branches grow up to their own instability again. As a result of this splitting, so- 
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Figure 4. Fractal patterns observed for zero anisotropies e c = e* = 0 on a numerical grid of size 
550 3 . The formation of fractals was found at the undercooling: (a) A = 0.70 and (b) A = 0.80. 


called “dublons” in 2D and so-called “triplets” in 3D appear at the tips of developed 
branches. A triplet consisting of three cooperating symmetry-broken fingertips 
formed at the center of the fractal-like structure is shown in Fig. 4. Such triplets 
were first modelled as dynamically stable objects in a 3D space using the phase- 
field method in Ref. 17 . We observed the formation of triplets in liquids at the 
undercoolings A < 1.0 as is shown in Fig. 4. Beyond the hypercooling limit of 
A > 1.0, smooth spherical structures grow as crystals without any anisotropy 15 . 


5. Complexity in crystal growth 

Considering the morphological spectrum, Fig. 2, one may outline one interesting 
feature: patterns which solidify at very small undercooling (AT < 0.15) and very 
large undercooling (AT > 1.0) exhibit smooth non-branched forms a . In the range 
of moderate undercoolings, crystals have branched and complicated forms with sec¬ 
ondary branches developed along preferable crystallographic directions for growth. 

In the present description, we consider complexity in crystal growth as a com¬ 
plexity in branched patterns versus disorder in solidifying system 18 . Two informal 
definitions may be drawn. We define: 

- complexity as a measure of structural inhomogeneity in the system; 

- disorder as a parameter characterizing atomistic kinetics around the solid-liquid 
interface. 


“It is true, certainly, for a chosen size of the computational domains used in the present work. 
For computational domains larger than presently used ones, one may expect a developing of 
morphological instability for crystals grown at very small undercoolings (e.g., for undercooling 
AT < 0.15, Fig. 2(a)). After such morphological instability, the crystals becomes branched ones. 
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Disorder 


Figure 5. Generic complexity of crystal patterns versus disorder in solidifying system, (a) Small 
deviations from equilibrium (a region of very small undercooling) and low kinetics of atoms attach¬ 
ment to the solid-liquid interface lead to simplicity of the crystal form, (b) Moderate deviations 
from equilibrium. Dendrite (left) is formed due to existence of anisotropy of interfacial properties. 
Fractal (right) is developed as a crystal with absence of interfacial anisotropy, (c) Large devia¬ 
tions from equilibrium (a region of very high undercooling) and very intensive kinetics of atoms 
attachment to the solid-liquid interface lead to simplicity of the crystal form. 

Prom these definitions, one may expect to observe smooth and uniform forms of 
crystals for both small disorder and high disorder in atomistic kinetics. Complex 
crystals can be some place “in the middle”. Figure 5 demonstrates this idea b . 

With small deviations from equilibrium (small undercooling), the driving force 
for atomistic attachment to the solid-liquid interface is very small, and the diffusion 
process ahead of the interface has enough time for smoothing of inhomogeneities 
in the thermal diffusion field. The shape is morphologically stable and it has very 
simple form without branches. This result is demonstrated in Fig. 5(a) for 2D 
modeling and it can be compared with the Fig. 2(a) for 3D modeling of crystal 
growth at small undercooling of the liquid. Thus, a high order on the atomistic 


b Such types of relationships “complexity - disorder” to appear in the literature seems to have been 
the similar diagrams “complexity - entropy” given by J.P. Crutchfield and K. Young, Phys. Rev. 
Lett. 63, 105 (1989). 
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level (low values of disorder) leads to smooth and simple crystal forms on the meso¬ 
scopic/macroscopic level of description. 

With moderate deviations from equilibrium (region of normal undercooling), 
the intensity of atomistic attachment to the solid-liquid interface does not provide 
stabilizing effect on the preserving of growth form against temperature gradients 
ahead of the interface in the undercooled liquid. The shape becomes morphologi¬ 
cally unstable and the secondary branches appear. This result (applicable to both 
dendrites and fractals) is demonstrated in Fig. 5(b) for 2D modeling. It can be 
compared with the Fig. 2(b)-(e) for 3D modeling of crystal growth in undercooled 
liquid as well. Thus, a moderate disorder on the atomistic level leads to complex¬ 
ity in growth forms on the mesoscopic/macroscopic level of description of pattern 
formation. 

With large deviations from equilibrium (very large undercooling), the driving 
force for atomistic attachment to the solid-liquid interface is very high. It leads to 
smoothing of microscopical inhomogeneities of the solid-liquid interface. The crystal 
shape is morphologically stable and it has very simple form without branches. This 
result is demonstrated in Fig. 5(c) for 2D modeling and it can be compared with the 
Fig. 2(f) for 3D modeling of crystal growth in highly undercooled liquid. A transi¬ 
tion to smooth patterns at higher undercoolings is known as a globular transition 
in crystal growth 3,12 . Thus, high intensity of atomistic kinetics on the microscopic 
level leads to smooth non-branched crystal forms on the mesoscopic/macroscopic 
level of description. 

Consequently, Figure 5 has a conceptual role in description of pattern forma¬ 
tion. It shows that at low and high disorder on the microscopic level (directly 
connected with atomistic kinetics) the patterns have low complexity in their own 
mesoscopic/macroscopic growth forms. In contrast, at the mid of microscopic dis¬ 
order (provided by moderate deviations from thermodynamic equilibrium) the de¬ 
veloping patterns exhibit variety and complexity. 


6. Conclusions 

Using computational modeling, non-equilibrium solidification of undercooled liquid 
has been analyzed for synthesizing results of the crystal growth forms. The role of 
anisotropy of the interface for selecting crystal patterns has been demonstrated in 
example of dendritic and fractal crystals. Particularly, it has been shown that the 
fractal crystals are patterns which are growing with isotropic surface energy and 
kinetics of atomic attachment to the interface. 

The morphological spectrum of crystals was analyzed as a sequence of forms in 
dependence from undercooling of a liquid (initial deviation from thermodynamic 
equilibrium). It was shown that patterns which solidify at very small undercooling 
and very large undercooling exhibit smooth non-branched forms. The branched 
patterns are in the intermediate region of undercooling. This fact has been used to 
construct a diagram “complexity-disorder” for the solidifying patterns. The diagram 



has a conceptual role in analysing mesoscopic/macroscopic growth forms versus 
disorder on the microscopic level which is directly correlated with atomistic kinetics 
at the interface. The maximum of complexity in growth forms has been observed 
at the intermediate deviation from equilibrium and a middle level of intensity of 
atomic kinetics. 
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COMPETITION OF DOUBLON STRUCTURE IN THE PHASE-FIELD MODEL 
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A doublon is one of the fascinating patterns found in ciystal growth. It fonts a pair of symmetry broken 
fingers. In this paper, we investigate the doublon pattern growing with the effect of other doublons. We have 
found that as the result of some competition, some doublons break their own structure and the number of 
doublon keeping its structure depends on diffusion length. 


1. Introduction 

The snowflake is a typical dendritic crystal of ice. The dendrite has been intensively studied, and it was 
found that the crystal anisotropy is essentially important for the steady growth of dendrites [1-3]. 

A doublon is a noteworthy pattern found by Ben Amar and Brener, in that it is a pattern growing 
steadily even in the isotropic system and is discovered in the field of crystal growth. It is a pair of 
symmetry broken fingers and has a stable groove. There are many fascinating researches of doublon. 
Akamatsu et al. found doublon patterns in an experiment of directional solidification [4], They predicted 
that doublon pattern exists in experimental condition of low anisotropy and high supercooling. Losert et 
al. investigated the stability of doublon structures in an experiment of directional solidification and a 
numerical simulation with a phase-field model [5], Samid-Merzel et al. found doublon patterns in an 
experiment of drying water film [6], Recently, doublon-like pattern was found in diffusion-limited growth 
of xenon crystals [7]. 

A phase-field model is a useful simulation model for the crystal growth and studied by many authors 
[8-10]. It has a form of the Ginzburg-Landau equation coupled with the diffusion equation. For the melt 
growth, Ginzburg-Landau equation represents the dynamics of phase transition from the liquid phase to 
the solid one. Karma and Rappel improved the phase-field model to simulate the case of negligible 
interface kinetics that is physically relevant at the low supercooling for a large class of materials [11], 

We used phase-field model to investigate the doublon pattern. We classified the doublon into surface 
tension doublon and kinetic one. Both are formed from small seeds of crystal of different sizes in wide 
parameter range [12]. A doublon can be formed through a tip-splitting process from a small single seed of 
crystals [13]. We also found a doublon pattern whose groove is oscillating. The groove oscillation does 
not decay in a narrow parameter range [14], 

The doublon growing with the competition of any other doublons has not been investigated though a 
lot of researches of doublon growing up alone have been published up to now. In this paper, we report the 
growth of doublon pattern under the competition of group of doublons using the phase-field model. 

In Sec.2, we introduce the model equations of the phase-field model. In Sec.3, the detail of numerical 
method used in this simulation is explained. In Sec.4, the results of simulation are shown and discussed. 
In Appendix, we explain a discretization method especially valid for isotropic case. 


2. Model equation 

The model equation neglecting the crystal anisotropy of the phase-field model is expressed as 
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rd,p = {p-ku{\-p 2 m-p' l ) + WV 2 p (1) 

d,u = DV 2 u + d,p/2, (2) 

where, A is a dimensionless parameter that controls the strength of the coupling between the phase and 
diffusion fields, p is an order parameter and p= 1 and p=- 1 correspond to respectively, solid and liquid 
phase, T and W are a time constant and diffusion constant, respectively. The variable u is the 
dimensionless temperature that is expressed as u=(T-Ti^/(L/Cp), where T, Tm, L and C p are respectively, 
the temperature, the melting temperature, the latent heat and the specific heat at constant pressure. The 
diffusion constant for u is denoted by D. The term d t p/2 in Eq. (2) represents latent heat production at 
the interface. 

The isotropic version of the fundamental equation of crystal growth that Karma and Rappel derived as 
the sharp-interface limit of the phase-field model is expressed as 

d,u = DV 2 u, (3) 

u t = -d 0 K-Pv n . (4) 


Equation (3) is the diffusion equation for u and Eq. (4) is the generalized Gibbs-Thomson condition, 
respectively, where d 0 , k , fl and v„ denote respectively, the isotropic capillary length, the interface 
curvature, the isotropic kinetic coefficient and the normal interface velocity. These parameters are 
expressed using W and t as 


d 0 

P 


XJ 


(5) 

( 6 ) 


where, / = 2V2/3, 7 = 16/15, F = V21n2, K = 0.13604. If the parameter A is chosen as 
A = (2 ID)/(K + JF), the isotropic kinetic coefficient vanishes, that is, the kinetic effect becomes negligible. 
This is the advantage of the phase-field model compared with other models. In this paper, we neglect the 
kinetic effect. 


3. Simulation 

The simulations are performed in a square box of size L x XLy=L x X 480. We simulate in the case of 
L x =4%0 and 320 to investigate whether the stability of the doublon depends on the lattice size or not. It has 
a periodic boundary condition with respect to horizontal direction, i.e. p(0,y, t) =p(L x ,y, t), u(0,y,t)=u(L„y,t), 
and has a mirror symmetric boundary condition with respect to vertical direction. In initial condition, 10 
seeds of crystal of radius 2.4, are set at random x (y=0) positions. All the space except for the seeds of 
crystal is initially supercooled A. If the tip of the pattern reaches y=440, the simulation is stopped, and 
the numerical data for the order parameter and the temperature are saved in our computer. The order 
parameter and the temperature profiles in the tip region (p ’(x,y),u ’(.x,y)) are used for the initial conditions 
for the next step, that is, p(x,y,t=0)=p’(x,y+320), u(x,y,t=0)=u’(x,y+320) for y<160, and p(x,y,t=0)=- 1, 
u(x,y,t=0)=- A for y>160. By iterating this process, we can observe the growth of doublons for a long 
time. We set W= T=1 to make the simulation easily in the isotropic case. 


4. Result and discussion 

Figures 1 show the group of doublon patterns at A=0.74 and £*=480. Figure 1(a) displays the first 
simulation from 10 crystal seeds at random positions. At first, a growing finger is affected by a nearest 
neighboring finger and make a pair, after that, the doublon pattern is made. A finger, which cannot make 
a pair, isn’t able to grow up because other doublons growing faster than one finger would consume the 
diffusion field, which is necessary to grow up. The nearer initial arrangement of two crystals is, the 
quicker it grows, because a doublon is formed early. The velocity of all the doublons v=0.165. So the 
diffusion length, which is the effective length of diffusion field, lj=2D/v=24.2. The left doublon is 
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curving and approaching to the central doublon. As a result, a finger of the left doublon can’t grow and 
the doublon structure is certainly broken. At the end of the simulation, two doublons survived. Figure 
1(b) is second simulation started from the result of first simulation. The central doublon breaks its 
symmetric pattern, however, two fingers of doublon grow together and keep their stability. Figure 1(c), 
(d) and (e) are third, fourth and fifth simulations, respectively. The right doublon gradually approaches to 
taller left doublon and the structure of right doublon is gradually broken as time passes. Figure 1(f) is the 
sixth simulation. The right doublon approaches to the left doublon more and more. After that, the 
structure of right doublon is perfectly broken. On the contrary, the left doublon keeps its doublon 
structure even though symmetrical form is partly broken affected by the right doublon. Figure 1(g) is the 
seventh simulation. The surviving doublon recovers its symmetrical form and grows alone. Figure 1(h) is 
the eights simulation. Only one doublon grows keeping its stability like it has grown alone from the 
beginning. 

Figures 2 show the group of doublon patterns at A =0.76 and £,=480. Figure 2(a) is first simulation. 
After the competition, three doublons retain their structure. Figure 2(b) and (c) are second and third 
simulations, respectively. In Fig.2(b), the left doublon approaches to central doublon, and its symmetry is 
partly collapsed. And then, the left doublon in Fig. 2(c) is collapsed by the effect of central doublon and 
cannot be observed. Figure 2 (d), (e), (f), (g) and (h) are fourth, fifth, sixth, seventh and eighth simulation 
respectively. These two doublons are growing together and keep their stability for a long time. Finally, 
two doublons remain with these parameters A =0.76, £,=480. 

Ben Amar and Brener calculated that the tip velocity of doublon is in proportion to 9th power of 
supercooling A [15]. We also confirmed the same power law of doublon velocity in the phase-field 
model [12]. Therefore, diffusion length IJ^XDfv) is in inverse proportion to the 9th power of supercooling 
A. Table 1 shows the relation of supercooling A, diffusion length U and the number of doublon that 
survives finally N s . Because the diffusion length l d is an amount that expresses a length of distance 
influenced by diffusion field, as the l d decreases, the number of surviving doublon increases. When 
£,=320, N s decreases compared with £,=480 at same A. The reason is that as £, decreases, the distance 
of doublons lowers and it is the same effect as that of increasing the diffusion length. 

Table 1 The relation of supercooling A, diffusion length l d and 

number of doublon that survives finally N s . 


A 

l d 

A«£,=480) As(£,=320) 

0.70 

39.6 

1 1 

0.71 

34.9 

1 1 

0.72 

31.0 

1 1 

0.73 

27.4 

1 1 

0.74 

24.2 

1 1 

0.75 

21.6 

1 1 

0.76 

19.2 

2 1 

0.77 

17.0 

2 1 

0.78 

15.2 

2 1 

0.79 

13.4 

2 2 

0.80 

11.7 

3 3 

0.81 

9.73 

3 3 


When A exceeds threshold ( A =0.8), the property of the group of doublon changes. Figures 3 (a), 
(b), (c) and (d) are, respectively, first, second, third and fourth simulations at A =0.82 and £,=320. Figure 
3(a) shows that the grooves of doublons are initially buried because of strong A [12], Flowever, each 
doublon makes new groove between other doublons. As they grow, all fingers approach each other and 
some grooves of their fingers begin to oscillate. Even though the grooves looks oscillating irregularly, 
whole envelope keeps stable form. This form looks like DBM and to investigate this pattern is future 
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(a) A -0.82,1,-320 (b)A-0.82,L,-320 



Figs. 3: Growing of DBM-like pattern at A =0.82, £,,=320. 



(a) A-0.7.L.-480 <b)A-0.74,L,«480 

Figs. 4: Patterns grown from 10 same size crystals that is at regular interval arrangement 


The appearance of these competition of doublons needs initial perturbation. In Figs. 4, we show some 
patterns grown from 10 same size crystals that is at regular interval arrangement. In Fig. 4(a) at A=0.7 
and £,=480, all the fingers go straight constantly. Figure 4(b) at A =0.74 and £,=480 is also grown from 
regular interval initial crystal arrangement Tip splitting is occurred in all the fingers. And all the fingers 
are growing evenly just like the growth in narrow channel. 



215 


5. Summary 

In this paper, we observe the doublons growing under the effect of other doublons. In isotropic cases, a 
doublon pattern cannot grow up stably when another doublon is growing up ahead. As time passes, the 
number of growing doublon decreases, affected by competition of other doublons. It has been understood 
that the number of doublons that survives to the last minute depends on the diffusion length. 

When A exceeds some value, the groove of doublon vanishes and makes new groove between other 
fingers. This form has stable envelop and whole shape looks like DBM. 

Appendix 
AI. Discretization 

The temperature and the order parameter of the phase-field model change in space continuously. However, 
for the numerical simulation, we have to discretize diffusion field of the temperature and order parameter. 
The growth of doublons depends on the anisotropy very sensitively. 

The simplest discretization of V « is 

{w„(i + 1J) + u n {i-\,j) + u n (i,j + 1) 

+«„(/,; -V)-4u n (iJ)}/&x 2 . (Al) 

The term n is the time step number and (i,j) denotes the lattice point. However, this scheme of the spatial 
discretization is not sufficient, because numerical anisotropy cannot be neglected. In the case of 
simulation including surface tension anisotropy and kinetic anisotropy, that numerical anisotropy is very 
small compared with these anisotropies and can be neglected. In this paper, because we would like to 
simulate more isotropic case, we use new discretization expressed as 

V 2 k = D{uSi + Xj +1) + u n (i - Xj -1) 

+ M B (i-U + l) + «„(i + U-l) 

-4w„(U)}/Ax 2 . (A2) 

V 2 k ~ a(Al) + b(A2). (A3) 

By tuning the parameters as a=2/3 and b= 1/6, the numerical scheme becomes more isotropic than 
Eq.(Al). In this paper, we use the method of discretization to investigate the doublon in more isotropic 
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STUDY OF THERMAL FIELD IN COMPOSITE MATERIALS 


PAVLA STEFKOVA, OLDRICH ZMESKAL, RADEK CAPOUSEK 
Institute of Physical and Applied Chemistry, Faculty of Chemistry, Brno University of Technology, 
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A new method of composite materials thermal parameters determination is described in this 
contribution. The transient pulse method is used for specific heat, thermal diffusivity and thermal 
conductivity determination. The evaluation is performed with the help of mathematical apparatus 
used study properties of fractal structures. The method presented is more general then the classical 
transient method commonly used for description of homogenous materials. 


1 Introduction 

The Fourier laws usually describe the heat conduction in solids; their stationary forms 
can be written with the help of equation [1,2,3] 

q 0 (r) = di vq = div(-i grad T) = -X AT, (1) 

where q 0 (r) is the specific yield of the heat source, q(r) is the density of heat flowrate, 
T(r) is the temperature and X is the constant thermal conductivity and equation 

X = c pP a = C p a, (2) 

where c p is the specific heat capacity at constant pressure, C p is the density of heat 
capacity, p is the mass density and a is the coefficient of thermal diffusivity of the body. 

The main aim of this contribution is to formulate a uniform mathematical system, 
which can describe the heat transfer independently of the properties of the matter. Fractal 
dimension and fractal measure will be the only parameters distinguishing the differences. 

Let’s choose the density of the heat capacity Cp as a basic quantity. It was found [4] 
that in fractal environment the temperature dependency of the heat capacity Cp density 
can be described as 


C p (r) = c p (r)p(r) = - = -^-AT, (3) 

a nc 

where k = 1.380658x 10 23 JK _I is the quantum of heat capacity (Boltzmann constant), 
% = 1.05457266 xlO -34 Js is the modified Planck’s constant and 
c = 2.997925 x 10 s ms -1 is the speed of light in vacuum. The density of fractal physical 
quantity C p (r) in E - dimensional Euclidean space E„ (E = n ) (the density of heat 
capacity) was defined [5, 6] as 

G p (r) = k n(r) = k K r D ~ E , (4) 

where n(r) is the coverage of space (distribution of particles concentration), r is the 
radius of elementary quantity, K the fractal measure (number of elements in volume with 
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r= 1) and D is the fractal dimension. It is apparent already from this equation that in 
equally filled space (D = E ) the heat density is constant, while for the point source of 
the heat (D = 0, E = 3) the heat density decreases with the distance from the source with 
third power. From (4) we can calculate the heat capacity C s (r) using equation 

C s (r)=kN(r) = jC p (r)dV‘ =kK-^~, (5) 


where N(r) is the number of particles in volume F* = and dF* = d(/ : ) is the 
elementary volume of ^-dimensional space. For radial temperature field we can write the 
dependence of temperature on radius using (4) 


w= 


he 

T 


Kr D ~ E+1 

D(D-E + 2) ' 


(6) 


If we suppose that the heat permeates through the surrounding by the constant 
diffusivity in time r 2 = 4a Q t -r 2 , where r 2 = x 2 +y 2 +z 2 is a radius of fractal space 
and a 0 is the maximum value of diffusivity (for D = E). We get from (6) [8, 9] 


hc_ K(4a 0 tr^ n f r 2 r~ E+2)n 

k D(D-E + 2) [ 4a 0 tJ 


( 7 ) 


If the heat diffuses by the significantly lesser speed (r T 2 « a 0 t, small distances or 
long times), then the terms in parenthesis can be observed as significant in the expansion 
of exponential function (1 - x « e -Jt ) and we can write 

r k D(D-E + 2) \ 2 4a 0 t J 


If we substitute for the thermal diffusivity (2) a = 2 a 0 /(D -E + 2), where a is the 
coefficient of thermal diffusivity of the body with fractal dimension D, we obtain 

T,=-±^[2aHD-E+ (9) 
k D y 4at) 


For the total heat transferred to the body from the heat source 


Q = 


2 he _ fa _ 

k D[(D-E + 2)l2n\ {D - E)l2 


( 10 ) 


we can write 


c p p(4jiaty 


4 at 


( 11 ) 
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The relation (11) is applicable [1,2,3] for fractal dimensions D= 0,1,2 and 
topological dimension E = 3, see Figure 1. 


a) b) c) 



£ = 3 
Z) = 2 



Figure 1. Heat flow geometry for a) plane-parallel, b) cylindrical and c) spherical coordinates Euclidean space. 


2 Model calculations 


The maximum position can be determined by the derivation of (11) with the time 


aiogr f D-E | h 2 1 Q 

d\ogt 2 4 at J 


( 12 ) 


From this equation the thermal diffusivity at the maximal time can be determined 


a 


h 2 

2/m/. 


hi 1 

2(E-D)t m ’ 


(13) 


where / a is a coefficient that characterizes the deformation of the thermal field [2]. This 
coefficient is equal to one for the ideal plane source (E = 3, D = 2). The maximum 
temperature of the response for the Dirac thermal pulse is obtained by introducing of the 
thermal diffusivity (13) in (11) 



(14) 


From the ratio of equations (14) and (11) and with the use of (13) 



(15) 


it is possible to define the coefficient f a (fractal dimension D respectively) for every point 
of the experimental dependence 

2 In {TJT) 

M'Am) + ('m/'-!)' 


/, =E-D = 


(16) 
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The value of the coefficient^ could be also affected by the geometry of sample [2] or by 
the finite pulse width [4], 

The thermal capacity can be derived from Eq. (2): 

C - Q f e - Q { e-d 

P pTJir T^rexpO) pT m h E ~ D ^2/rexp(l) 
as well as the thermal conductivity of the studied fractal structure: 

-e__r_Ez£_f 

P 2{E-D)Tj m h E D 2 2n exp(l) J 



where exp(l) is Euler number and f are the coefficients that characterize the 
deformation of the thermal field [2], 



Figure 2. Time dependencies of the model temperature responses for the Dirac thermal pulse (for the heat flow 
geometry from Figure 1 calculated by Eq. (11) 

Figure 3 represents time-temperature dependencies (c.f. (11)) calculated for 
spherical (D = 0 ), cylindrical (Z>= 1), planar (D = 2), and "cubic" (D = 3) geometry of 
the heat source (see Figure 1). From these dependencies the fractal dimension was 
reconstructed with help of Eq. (16). The results are in the Figure 3. The differences 
between input fractal dimensions and the calculated ones are in the whole time interval 
negligible. It is caused by the fact that the term (16) can’t be numerically calculated for 
t -> t m . When the valued (fractal dimension D, respectively) is known, it is feasible to 
determine the parameters of the studied thermal system with the aid of the (13) - 
(18) equations. 
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0,0 0,3 0,6 0,9 

at (m 2 ) 


Figure 3. Time dependencies of the reconstructed fractal dimensions (16) calculated from temperature responses 
to the Dirac thermal pulse (for the heat flow geometry from F igure 1 calculated by Eq. (11) 

3 Experimental 

Measurements of the responses to the pulse heat were performed using the 
Thermophysical Transient Tester 1.02 developed at the Institute of Physics, Slovak 
Academy of Science, The measured sample of composite thermal insulating material was 
round with the diameter R = 0.03 m. Its density was p= 247.885 kg m -3 for its thickness 
h = 8.2 mm. 


plane-parallel source fractal source point sour 



Figure 4. Current flow geometry: a) plane-parallel, b) fractal, c) point (for different ratio of length contact 
respectively) source. 

In Figure 4 three possible configurations of the experimental arrangements are 
shown. In Figure 4a the diameter of the specimen is equal to the diameter of the heat 
source, in Figure 4c, diameter of a heat source is far smaller than specimen’s diameter. 
Figure 4b shows the real situation, when the heat is delivered irregularly (either from the 
source of finite size (capacity) or from a source with specific composition of heat sources 
- e.g. hot-disc). 
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4 Results 

The typical time responses of temperature for the rectangle (Dirac) pulse of different 
input power with width At = 2 ms are presented in Figure 5. The corresponding heat 
energy was changed from 191 J m“ 2 to 1944 J m 2 . From this figure it is evident that the 
position of the dependence maximum t m changes slowly, but the maximum value of 
temperature T m is increased. 



Figure 5. Thermal responses of the sample measured by the pulse transient method for different pulse power 


0,25 |-, 200 



0 500 1000 1500 2000 

Q/S (Im' 1 ) 

Figure 6. The dependences of the time of characteristics’ maximums and maximums temperature values on the 
heat energy. 

The detailed dependences of the time corresponding to the characteristics’ maxima 
and maximal temperature values of the heat energy of the source are in Figure 6. It is 
evident that the positions of peaks increased slowly, such that the diffiisivity is 
approximately constant, see (13). The dependencies of fractal dimensions were 
calculated with the help of Eq. (16) (analogically to the fractal dimensions calculated for 
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models from Figure 2 in Figure 3). They are presented in Figure 7. It is evident, that 
these dependencies are very different for model characteristics (Figure 3). It is caused 
probably by the losses of heat during its propagation through the composite material. 

From the Figure 7 it is evident that for very short times there is a value of the fractal 
dimension D « 3 and therefore, the plane heat source is formed. The value of the fractal 
dimension decreases with increasing time, since the heat disperses into the space. 



Figure 7. Fractal dimension of the heat distribution in the specimen determined from increased part of 
characteristics. 


The final parameters: thermal diffusivity (13), specific heat capacity (17) and 
thermal conductivity (18) for planar heat source (JD = 2) are presented in Table 1. It is 
evident that the results are not dependent on the heat energy of source. The statistical 
error is less than 4 % for all three cases. However, the situation is more complex because 
of the heat losses and also because the measured material was inhomogeneous. 


Table 1: Thermal parameters of studied insulating composite material 


Q/S (J m -2 ) 

<„(S) 

A7MK) 

a (m 2 s' 1 ) 

c p (J kg“‘ 1C 1 ) 

A (W m -1 K~‘) 

191.13 

142.75 

0.024 

2.36xl0' 7 

957.26 

0.056 

496.99 

149.30 

0.060 

2.25x1 O' 7 

990.99 

0.055 

808.20 

151.40 

0.089 

2.22xl0' 7 

1078.32 

0.059 

1066.81 

144.86 

0.124 

2.32xl0' 7 

1025.34 

0.059 

1489.58 

153.53 

0.176 

2.19xl0' 7 

1009.60 

0.055 

1944.02 

151.33 

0.234 

2.22xl0' 7 

988.72 

0.054 


(2.26±0.06)xl0 -7 (1008.37 ±37.60) (0.056 ± 0.002) 


Conclusion 


The results of thermal responses to the Dirac pulse of supplied heat are discussed. 
Simplified heat conductivity model was used [7] to interpret the experimental outcomes. 
The model is based on published [1] expectations. The results show the image of heat 
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distribution in the specimen for various heat powers from the source. These evaluations 
could be used for more accurate determination of the thermal parameters of materials. 
The differences between model calculations and experimental results are evidently 
caused by the inhomogeneities of the composite material studied and by the heat loss 
during the measurement. These discrepancies will be studied in more detail in our further 
work. 
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SIMULATION OF GEOCHEMICAL BANDING IN 
ACIDIZATION-PRECIPITATION EXPERIMENTS IN-SITU* 


MAYSAM MSHARRAFIEH, MAZEN AL-GHOUL AND RABIH SULTAN 
Department of Chemistry 
American University of Beirut 
Beirut, Lebanon 
E-mail: rsultan@aub.edu. lb 
Fax: 961-1-365217 


This paper explores the possible similarities between the well-known Liesegang banding 
phenomenon in precipitate systems, and the stripe formation observed in a large number 
of rocks. We present new experiments performed in-situ (real rock systems), to simulate 
the band formation through the acidization of a ferruginous limestone rock, causing 
dissolution and precipitation reactions. The results are analyzed by microscopy, AA 
and XRD techniques. The correlation between the Liesegang gel experiment and the 
processes taking place inside the rock medium is established. A theoretical model to 
support our experiments is also presented. 


1. Introduction 

Periodic precipitation, known as Liesegang banding 1,2 , occurs when two co-prec¬ 
ipitate ions interdiffuse in a gel medium. This occurs through the coupling of 
the precipitation reaction with diffusion. As a result, spatial oscillations through 
periodic precipitation are displayed in the form of bands in ID, or in the form of 
rings in 2D. Similarities with the Liesegang phenomenon mainly include the banded 
patterns found in a vast variety of rocks (geochemical self-organization). Banded 
rock formations arise from the cyclic precipitation, as mineral-rich water infiltrates 
a porous rock and reacts to form an insoluble product 3 . 

Examples of rock types whose textures are attributed to such processes include: 
banded iron oxide minerals, zebra spar 4 , wood-grained chert 3 , and banded agates 
and geodes 5,6 . Hematite rings in sandstones are an example of rhythmic banding 
similar to a Liesegang type experiment. Hematite (cherry red Fe 2 C> 3 ) is a character¬ 
istic mineral of Liesegang rocks occurring as ring-shaped aggregates several tens of 
microns in diameter 7 . Another commonly cited example of Liesegang bands in rocks 
is the striped precipitation of iron oxide minerals upstream of an oxidative front, 
lagging behind a dissolution front within a pyrite (FeS 2 ) rock bed. The scenario 


•This work is supported by a grant from the Lebanese National Council for Scientific Research 
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leads to the banded deposition of goethite (Fe 3 + 0(0H) ) behind the dissolution 
front 8 . A mechanism for this type of band formation was set forth 8 , based on a 
bifurcation the Ostwald supersaturation-nucleation-depletion cycle 9 . 

Agates represent one of the classic types of rocks whose self-organized structure 
was attributed to the Liesegang mechanism of banded precipitation. They consist 
of microcrystalline SiC >2 tight aggregates that display a rich colored structure due 
to the impurities present in the SiC >2 matrix. The mechanism yielding ring-shaped 
domains is attributed to the composition of agate which varies greatly. It consists 
of microcrystalline silica such as chalcedony, carnelian, amethyst, jasper, opal, and 
flint, often occurring as layers in agate which are deposited from aqueous solutions 10 . 
The experimental simulation of the moss agate formation by precipitating iron (II) 
silicate solution in water glass showed that reaction-diffusion processes within the 
magma may cause the growth of ring-shaped domains that yield agate-type rock 
upon cooling of the melt 11 . 

Whereas theoretical modeling attempts to simulate geochemical self-organi¬ 
zation exist in the literature 8,12,13 , experimental simulations are scarce and are 
limited to Liesegang-type experiments in gels, not in real rocks. The Liesegang gel 
method was used to model gallstone formation in vitro, approximating the con¬ 
ditions present in bile salt systems 14,15 . In this study, we propose to perform 
acidization-precipitation experiments in-situ, using porous ferruginous limestone 
rock samples. We then present a reaction-transport model to initiate a theoreti¬ 
cal study that will serve as a basis for the mechanistic unraveling of the observed 
phenomena. 

Rock acidization studies were conducted in dolomite 16 , and sandstone cores 17 , 
but no attention to pattern formation was given. The proposed experiment consists 
of allowing an acid to slowly infiltrate through a rock medium. The acid causes 
the dissolution of parts of the latter, and the subsequent precipitation of another 
mineral behind the dissolution front. We anticipate the precipitation will occur 
in the form of bands. Consider a rock sample of limestone rich in calcite mineral 
(CaCOs). A flow of acidic water causes the dissolution of the rock according to the 
following equation: 


CaC0 3 (s) + 2H +(aq) —» Ca 2+ (aq) + CO 2 {g) + H 2 0(Z) ( 1 ) 


The presence of anions such as, say, SO 4 in the infiltration flow can precipitate 
anhydrite (CaSO-i) or gypsum (CaS 04 - 2 H 2 O), according to the reaction: 


Ca 2 + (a<jr) + SO 4 - (aq) CaSO 4 {s) 


( 2 ) 
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2. The Experiment 

2.1. Setup 

A red brown, porous ferruginous limestone rock was used in the experiment. A 4.0 
M H 2 SO 4 solution was allowed to infiltrate into the rock by means of an infusion 
pump (Thermo-Orion M361 Multi-rate Infusion Pump). The pump syringe was 
filled with 50 mL of H 2 SO 4 , and the pump was set to deliver the acid at the rate of 
1.0 mL per hour, through a Tygon tube fitted into a tiny orifice (3 mm diameter, 
and 1 cm depth) carefully drilled in the rock. With this injection setup, a well- 
controlled flow could be attained. The pump syringe was repeatedly refilled, as 
soon as the acid was consumed. 

2.2. Results and discussion 

Texture and color alterations within the ferruginous limestone rock (by comparison 
before and after acid injection) gives a preliminary idea on the chemical processes 
that have taken place. A photomicrograph illustrating such modifications is de¬ 
picted in Fig. 1. Frame a shows the bare rock before the reaction, while the 
acid-invaded medium is seen in frame b. 



Figure 1. Rock texture before (a) and after (b) acid injection. The latter displays the white 
crystals of CaS04 (labeled W) embedded within the rock. The two photomicrographs are 
of the same magnification (lOx). The scale is indicated on the picture. 


The white crystals, labeled ”W”, embedded within the rock can be distinctly 
remarked after the dissolution and precipitation reactions (frame b), and consist of 
the salt CaSC> 4 , precipitated by reaction 2. The rock has the appearance shown in 
Fig. 2 after 161 days of steady acid injection (4.0 M H 2 SO 4 ). 

The white precipitate is first concentrated in the central region, spanning a 
circular zone surrounding the injection center. To do a preliminary test for the 
presence of any remaining calcium carbonate in this deposited white zone, a drop 
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Figure 2. CaSC>4 deposition in the limetsone rock sample, infiltrated by H2SO4. The 
central region is a dense precipitate zone. Then, beyond a brown depleted zone, a distinct 
belt of CaS04 suggests the formation of a first Liesegang ring. The photo is taken on day 
161. A 1 cm scale is indicated on the picture. 


of concentrated acid (HC1) is added. No effervescence is produced indicating the 
depletion of the region from carbonates. This will later be confirmed by X-ray. 
Effervescence is due to CO 2 produced when the acid reacts with the carbonate ions 
(CO 3 - ). Beyond this region, another region appears, delineated by the boundary of 
the infiltration front. Essentially, no white precipitate (similar to that in the center) 
is observed in this region. We will refer to this region as the ”inter-band zone”. No 
CO 2 effervescence occurs there upon HC1 addition, also suggesting a depletion from 
the presence of carbonate salts (consumed by dissolution). Following the inter-band 
zone, comes a distinct ring of white precipitate (with traces of yellow). This belt of 
mainly white precipitate is believed to mimic a first Liesegang band, formed after the 
depleted inter-band zone. A photomicrograph of the rock around that ring (depicted 
in Fig. 3) clearly reveals a difference in texture between it and both the bare rock 
and the acid-reacted zone. This sharp contrast between the ring domain and the 
medium surrounding it favors the hypothesis of an individualized Liesegang band. 
The picture was taken with a Nikon (COOLPIX 4500) digital camera, observing 
through the lens of a fluorescence microscope (Zeiss AXIOVERT 200). The front 
edge is indicated by the red arrows on the Figure (boundary between the dark and 
light brown regions). So we see that the acidity front has reached a location slightly 
after the first ring. 

We now attempt to identify the salts formed in the different zones of the rock 
(notably the central region and the ring domain). Simple tests were first conducted. 
Samples of white precipitate from both the central region and the peripheral ring 
were treated with HC1. No fizzing indicative of chemical reaction of acid with 
carbonate was noticed for the white precipitate in the central region. A small sample 


Figure 3. Photomicrograph showing the texture contrast between the bare rock (upper 
portion) and the acid-invaded zone (lower portion), demarcated by the white and slightly 
yellow crystals (at the center). The picture is obtained at a 4x optical zoom magnification. 
The diameter of the displayed rock portion is approximately 1.5 cm. The arrows indicate 
the position of the front, moving upwards. 


Table 1. Analysis of the ring domain for Ca and Fe obtained by flame atomic ab¬ 
sorption analysis. The second and third columns indicate the concentrations in mg/ 
L (ppm) of Fe and Ca. These concentrations are converted to masses, and the mass 
ratio of calcium to iron is finally calculated (last column). 


Sample ID 

Fe (ppm) 

Ca (ppm) m Fe (mg) m Ca (mg) 

mco/mp. 

Center 

3.528 

36.19 0.0353 0.3620 

10.3 

Ring 

9.629 

8.947 0.09626 0.08947 

1.08 


of white salt from the ring dissolved in HC1, yielding a yellow solution, attributed to 
the presence of ferric ions originating from the rock medium (ferruginous limestone). 
The presence of Fe 3+ was confirmed by testing with KSCN solution. Upon addition 
of a few drops of SCN - , the solution turned blood-red indicating the formation of 
the FeSCN 2+ complex. Flame atomic absorption analysis of the precipitate (done on 
a Thermo-elemental Solaar atomic absorption spectrophotometer), in both the ring 
and the central region (after dissolution in HC1) was then undertaken to determine 
the elemental mass ratio of calcium to iron. The results are recorded in Table 1. 

As can be inferred from the above results, the central region is much richer in 
calcium ions confirming that the obtained precipitate is overwhelmingly calcium 
sulfate. In the ring domain, it is established that both iron and calcium are present 
in almost a 1:1 ratio. A sample of white salt from the ring zone (traces) dissolved 
in water; but its fairly high calcium content still points toward the possible pres¬ 
ence of calcium sulfate in the ring. For a rigorous characterization of the different 
rock regions (before and after acid injection), we now carry out an X-ray crystallo- 
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graphic analysis. This aids in the understanding of the chemical processes that took 
place inside the rock due to the H2SO4 infiltration, and verifying the mechanism of 
Liesegang ring formation. 


2.3. X-Ray analysis 

Powder X-ray diffraction data is collected using the reflection geometry. Samples 
of the white salt from the central region (near the injection site), and the ring were 
analyzed using X-ray crystallographic techniques. A sample from the bare rock was 
also studied. The X-ray diffractometer (Bruker D8 Discover) was run at 40 kV and 
40 mA. The steps are in increments of 0.01 degrees, and counts were collected at 0.5 
seconds per step. The vertical axis records the X-ray intensity, while the horizontal 
axis records the scanned 26 angles, in degrees. Low angles (large d-spacings) lie 
to the left. The peak positions and their intensities provide important information 
about the structure of the material. The plots are shown in Figs. 4, 5 and 6. 

We search for calcite (CaC0 3 ), gypsum (CaS0 4 .2H 2 0), and anhydrite (CaS0 4 ) 
in each of the sampled areas. The X-ray results for the bare rock sample show that 
it is rich in calcite (CaC0 3 ) with only very few traces of gypsum. This is inferred 
from Fig. 4 and Table 2. 



2 theta 


Figure 4. X-ray diffraction spectrum of the bare rock. The rock is overwhelmingly com¬ 
posed of the calcite (CaCOa) mineral (C peaks). 


The analysis of the white precipitate in the central region reveals that it is 
predominantly gypsum, and to a lesser extent, anhydrite (see Fig. 5). Traces of 
monohydrocalcite (CaC0 3 H20) were also identified (two low intensity peaks at 
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Figure 5. X-ray diffraction spectrum of the central region after the dissolution- 
precipitation reactions. The extensive formation of CaSC>4 as anhydrite (A) and gypsum 
(G) is evident. 


Table 2. Relative abundance of CaSC>4 and CaC03 in the central region, the remote 
ring (1st Liesegang band) and the bare rock, determined by powder X-ray diffraction 
analysis. The presence of CaSC>4 in the ring is confirmed. 



Bare Rock 

Central Region 

Ring 

Total counts (gypsum 4- anhydrite) 

36.4 

742.8 

279.3 

Total counts of calcite 

569 

35.8 

114.9 

Ratio CaS0 4 /CaC03 

0.0640 

20.7 

2.43 


20 = 36.2° and 51.5°). Note that the calcite, anhydrite and gypsum peaks (C, A 
and G respectively) all lie in the region between 20 = 20° and 60°. Table 2 shows 
that in the central region, CaS(>4 (as gypsum and anhydrite) is overwhelmingly 
dominant over CaC0 3 , which has essentially dissolved by virtue of reaction 1. 

Finally, the presence of CaS04 in the ring is confirmed (see the gypsum peaks 
in Fig. 6). Table 2 shows that gypsum is dominant over calcite. This realization is 
the most important result in the study, as it reveals to a great extent the viability 
of a Liesegang-type scenario in certain pattern forming processes in rocks. 





232 



10 20 30 40 50 60 70 80 

2 Theta 


Figure 6. X-ray diffraction spectrum of the white precipitate in the ring at the rock pe¬ 
riphery (see Fig. 2). The presence of gypsum (CaSC>4 • 2H2O) in the belt after a brown 
depleted zone (Figs. 2 and 3) suggests the birth of a first Liesegang ring. 

3. Theoretical Modeling 

We introduce a simplified reaction scheme adopted from equations 1 and 2, incor¬ 
porating both dissoltution and precipitation: 

A + 2X Y (3) 

Y + Z^B (4) 

where A represents a solid mineral (here calcite, CaCOa), X the infiltrating 
solution (acidic water, H + ), Y the dissolved salt material (Ca 2+ ) from the reaction 
with X , Z the counter-ion from the infiltrating solution (here SO 2- ) which reacts 
with Y to form precipitate B (CaSO,*). 

The coupling of transport (diffusion and percolation flows) to chemical reactions 
(here dissolution and precipitation) could cause the deposition of the B mineral to 
take place in the form of bands behind the A dissolution front, just resembling those 
of a Liesegang pattern. A preliminary illustration of the rock alteration caused by 
the various reaction-transport processes (adopted from Refs. 3 and 8) is shown in 
Fig. 7. In 2D, concentric rings of the precipitate are expected to form, originating 
from a central diffusion source, in a way similar to the behavior observed in Fig. 2 
(the marked deviation from circular symmetry is due to the irregular percolation 
inside the porous medium). In the following treatment, we consider only diffusion 
(for simplicity) and ignore percolation, convection and water pressure effects. We 
adopt the model of Muller and Polezhaev 18 , modified by Al-Ghoul and Sultan 19,20 . 

The reaction-diffusion processes for the aqueous species X, Y, and Z are de- 
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space 


Figure 7. Acid infiltration front (A) causing the dissolution of the main rock mineral (A). 
Another rmineral ( B ), undergoes a banded precipitation behind the dissolution front. 


scribed by equations 5 to 7. Dx , Dy, and D z are the diffusion coefficients, k\ and 
k 2 are the rate constants of reactions 3 and 4 respectively, and V 2 is the Laplacian 
operator, which will be reduced to ID. The p's denote the average densities of solid 
salts in the form of small particles (called nuclei), and the p's represent the average 
density of solid salt in the form of big particles. Let c A and c B be the concentrations 
of the dissolved salts A ( aq ) and B (aq ) respectively. If c B exceeds a critical value 
C3, small particles (nuclei) nucleate in the salt solution at a rate v l . If c B exceeds 
some other parameter C2, B nuclei are transformed into large particles at a rate v 3 .; 
otherwise, they dissolve at a rate v 2 . When c B exceeds the value ci, large particles 
of the B precipitate grow at a rate v 4 . 

The evolution equations of p A , p B , p A ,p B , c a, and c B are given by (8-13). 

The Dc's are the diffusion coefficients of the dissolved salts. 

^ = D x V 2 X-2k 1 X 2 p A 
BY 

— = D Y V 2 T + 2k x X 2 p A - k 2 YZ 
^ = D z V 2 Z-k 2 YZ 

= D Ca V 2 c a + k\X 2 p A - V!(c A ) + v 2 (c A )p A - v 4 (c A )p A 
= D Cb X 2 c b + k 2 YZ — v 4 (c B ) + v 2 (c B )p B - v 4 (c B )p B 
= M c a) - M C /0 + V 3 {c A )]~p A 
= V 1 (Cfl) - \V2{C B ) + V 3 {c B )]~ Pb 
= v 4 {c A )p A + v 3 (c A )p A - hX 2 p A 
= v 4 (c B )p B + v 3 (c b )p b + k 2 Y Z 


(5) 

(6) 

(7) 

( 8 ) 
(9) 

( 10 ) 

( 11 ) 

( 12 ) 

( 13 ) 
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The explicit forms of the rate functions are as follows: 


Vi (c) = a(c - c 3 )0[c - c 3 ] 

(14) 

v 2 {c) = /?(c 2 - c)0[c 2 - c] 

(15) 

^3(c) = l(c - c 2 )@[c - c 2 ] 

(16) 

V 4 (c) = 5(c — cj)0[c - ci] 

(17) 


where a, /3, 7, and <5 are the rate constants and 0(x) is the heaviside function. 
The following initial conditions apply (front located at x — 0): 


At t = 0, a: < 0 : X = X 0 ,Y = 0, Z = Z 0 (18) 

At t = 0, a; > 0 : X = 0,Y = 0, Z = 0 

And p A (t = 0,x) = p Ao \ p B (t = 0,x) = 0 

We assume here that once A dissolves, it does not precipitate anymore. There¬ 
fore, p A is zero, and p A is expected to decrease. Furthermore, the rate of formation 
of A nuclei vj(ca), and that of growth of particles 04(0,4) are both zero and hence 
disappear from the evolution equation for the concentration ca (equation 8). The 
latter is thus reduced to: 


^ = DcA V 2 c A + k 1 X 2 p A (19) 

Similarly equation 12 simplifies to: 

= -k 1 X 2 p A (20) 

Equations 5-13 were solved numerically; the results are plotted in Fig. 8. As ex¬ 
pected, the U-mineral exhibits a banded deposition behind the A-dissolution front, 
in a way similar to the formation of Liesegang bands in the Chemistry laboratory. 
Thus, the Liesegang banding mechanism could constitute one of many possible 
routes for the rise of geochemical self-organization. A theoretical study to translate 
a similar scenario was undertaken by Sultan et. al. 8 , but using a different model. 

The above study reveals an interesting correlation between the Liesegang phe¬ 
nomenon and the pattern formation in rock systems. The continuation and develop¬ 
ment of the theoretical work is under close consideration. The experiments require 
further refinements, but the preliminary results seem to be promising. The time 
scales of such experiments are very large, and the reactions need to be run for very 
long times. Also larger rock samples should be used to span larger length scales. 
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Figure 8. Computer solution of the reaction-diffusion equations 5-13, using the following 
model parameters: Xq = 25;Yo = 0;Zo = 200; fci = 1 x 10 -4 ; fe2 = lx 10 -4 ; D x = Dy = 
Dz = 1 x 10 _B ; Dca = D C g 1 x 10~ 5 ; p A0 = 20. The plot (at a fixed late time) shows bands 
of the B-mineral deposit behind the dissolution front of the embedded A mineral. The 
dashed line shows the profile of the infiltrating species (acid) X. 
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We analyze the dynamics of adsorbed molecules within the bulk-mediated surface diffu¬ 
sion framework. We consider that the particle’s desorption mechanism is characterized 
by a non Markovian process, while the particle’s adsorption as well as its motion in the 
bulk are governed by Markovian dynamics, and include the effect of an external field in 
the form of a bias normal to the surface. We study this system for the diffusion of par¬ 
ticles in a semi-infinite lattice, analyzing the conditional probability to find the system 
on the reference absorptive plane as well as the surface dispersion as functions of time. 
The agreement between numerical and analytical asymptotic results is discussed. 


During the last few decades, the literature on diffusion processes has covered 
from diffusion-limited reactions 1 and anomalous diffusion or diffusion in disordered 
systems 2 , through heat conductivity in solids 3 to other diffusion problems in 
material science 4 . Among the many problems studied in material science, the 
dynamics of adsorbed molecules at an adsorbing surface is a fundamental issue in 
interface science and is crucial to a number of emerging technologies 5 (for instance, 
see Refs. 6 ’ 7,8,9 and references therein). 

Recently, the mechanism of bulk-mediated surface diffusion has been identified 
and explored. The importance of bulk-surface exchange in relaxing homogeneous 
surface density perturbations is experimentally well established iMi,12,13,14,is -phis 
mechanism typically arises at interfaces separating a liquid bulk phase and a second 
phase which may be either solid, liquid, or gaseous. Whenever the adsorbed species 
are soluble in the liquid bulk, adsorption-desorption processes occur continuously. 
These processes generate surface displacement because desorbed molecules undergo 
Fickian diffusion in the liquid’s bulk, and are latter re-adsorbed elsewhere. When 
this process is repeated many times, an effective diffusion results for the molecules 
on the surface. 

Usually the studies performed in this type of systems are done within the frame- 
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work of a Master Equation scheme 1G ’ 17 ’ 19 , where the particle’s motion through the 
bulk and the adsorption-desorption processes are Markovian. In a series of recent pa¬ 
pers we have shown some of the most important features of this phenomenon 6 ' 7 ' 8,9 . 
In particular; we have studied the variance {r 2 (t)) p i ane of the position r = (x, y) 
on the interface, and the conditional probability P{z = 1, t) St y P{x, y, z = 
1; £|0,0, 1; t = 0) to find the particle on the interface at time t, if it was initially 
at (0,0,1), by means of analytical and numerical methods. In those papers we 
have studied the cases of infinite and bounded bulk, where the particle dynamics is 
governed by Markovian and non Markovian processes. 

In this work we address the dynamics of adsorbed molecules when, in addition 
to the particle’s desorption mechanism being characterized by a non Markovian 
process -while the particle’s adsorption and its motion in the bulk are governed 
by a Markovian dynamics-, there is a biased behavior for the motion along the 
vertical axis (that is, we consider the effect of some external field normal to the 
interface). Non Markovian desorption process can occur when the surfaces contains 
“deep traps”, capture and re-emission from surfaces that contain sites with several 
internal states such as the “ladder trapping model”, proteins with active sites deep 
inside its matrix, etc. 20 ’ 21 . When non Markovian process are present, it is necessary 
to resort to Generalized Master Equations, that are characterized by a “memory 
kernel” and may be related univocally with a CTR.W scheme 22 . 

Our aim in this work is to study the influence of both, the non Markovian 
desorption together with the indicated biased dynamics, on the effective diffusion 
process at the interface z = 1. For that purpose we calculate the temporal evolutions 
of the (r 2 (t)) p i ane and of P(z = l,t). 

Here we exploit the same framework as in 8,9 . P{n,m,l\t) satisfies 

P(n, m, 1; t) = 7i P(n, m, 2; t) - [ dt' K{t')P(n, m, 1; t - t'), 

Jo 

+cci [P{n - 1, m, 1; t) + P(n + 1, m, 1; t) - 2P(n, to, 1; t )] 
+/3i[P(n,m-l,l;t) + P(n,m+l,l;t)-2P(n,TO,l;t)], for l = 1 

P(n,m,2;t) = f dt' K(t')P(n,m, 1; t - t 1 ) + 7 iP(n,m, 3;f) 

Jo 

-y 2 P(n, to, 2 ; t ) - 7 i P(n, to, 2 ; t) 

+a[P{n - 1, to, 2; t) + P{n + 1, to, 2; t) - 2P(n, m, 2; t )] 

+/?[P(n, to — 1,2; t) + P(n, m + 1,2; t) - 2P(n, m, 2; t)], for l = 2 
P(n, to, l; t) = a[P(n - 1, to, f; t) + P(n + 1, to, f; t) - 2P(n, m, /; t)] 

+0[P(n, m - 1, l-1) + P(n, m + 1, /; t) - 2P(n, to, Z; t)] 

+ 7 i [P(n, to, l + 1; t) - P(n, m, l;t)] + 7a [P(n, m, l - 1; t) 
—P(n,m,l;t)], for l > 3 (1) 

where a and p are the transition probabilities per unit time through the bulk in 
the x, y directions respectively; while 7 i and 7 2 are the transition probabilities per 
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unit time through the bulk in the z direction that, when 71 ^ 72 indicates a biased 
behavior (or the presence of an external field). It is important to note that the 
model presented in Eq. (1), allows for the possibility that the particles can move 
in the plane z = 1 with temporal frequencies oq in the x direction and Pi in the 
y direction. K(t) represents the memory kernel for desorption at all sites over the 
z = 1 surface (that is for ( n,m,l = 1)). It is clear that, when 7i = 72 = 7 and 
ori = /?i = 0, we recover the same set of equations used in 8,9 . 

Taking the Fourier transform with respect to the x and y variables and the 
Laplace transform with respect to the time t in the above equations, we obtain 


sG(k x , k y , 1; s) - P{k x , k y , 1, t = 0) = 71 G{k x ,k y , 2; s) + Ai{k x , k v )G(k x ,k y , 1; s) 

-K(s)G{k x ,k y , 1; s), for l = 1 

sG{k x , k y , 2; s) - P(k x , k y , 2, t = 0) = A(k x , k y )G(k x , k y , 2; s) + K{s)G(k x , k y ,l-,s) 
—71 G(k x , k y , 2; s) + s) 

—72 G(k x , k y , 2; s), for l = 2 

sG{k x , fey,I; s') - P(k x , ky, l,t = 0) = A{k x ,k y )G(k x , k y , /; a) + 71 [G(k x , k y ,l-l;s) 
—G(k x , ky,l ; *)] + 72 [G(k x ,k y ,l + 1; a) - G(k x , k y ,l, s)], 

for l > 3 (2) 


Here we have used the same definitions as in 6 ’ 7,8,9 . In particular we have 
A(k x , k y ) = 2<*[cos(fc x ) - 1] + 2/3[cos(fc„) - 1], and Ai(k x , k y ) = 2au[cos(A; x ) - 1] + 
2/3i[cos(/e y ) — 1], 

Clearly, the above equations for G{k x ,k y ,l\s )] are similar to Eq. (2) in 7 , with 
K(s) instead of 5 , and the unbiased 7 replaced by 71 and 72. Therefore all results 
obtained in 6,7 remains valid for a non Markovian dynamics when S is replaced by 
K(s), and the bias is adequately included. 

In what follows, and in order to simplify and to focus on the joint effect of both, 
the non Markovian desorption and the bias, we adopt a = p and oq = Pi. By 
using Eq. (12) of Ref. 7 , {r 2 (s)) p i an e turns out to be the ratio of two complicated 
functions of s 


(r 2 ( S )) piane = 


N(s) 

D( S y 


(3) 
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where 

N(s) = (8a/f(«) ti) ( 7 ? +7 1 + s 3 + 3 7l 2 s + 3 7 fs + 3 7 i 72 s 


+3 7 is 2 + 3 72 s 2 - V( 7 i + 72 + s) 2 - 4 7l72 ( 7 ? + ( 72 + s) 2 + 7i(72 + 2s)) 
+(8ai 7 i 72 ) f y /( 7l + 7 2 + s) 2 - 4 7 i 72 ( 7l 2 + 2 7 is + ( 72 + s) 2 ) 

- ( 7 i + 72 + s)((7i - 7 2 ) 2 + 2(72 + 72) s + s : 


'>)• 


D{s) = V (71 + 72 + s) 2 - 4 7i7 2 { y^((72 - K (s)) 
((72 - h 


- K(s))( 7? + 2 7l s + (72 + s) 2 ) 


- '/(ji + 72 + s) 2 - 4 7l72 ( 72 - i<r(s))( 7l + 72 + 
+\/7i72 (V(li + 72 + s) 2 - 4 7l72 ( 7l + 72 - K(s)) 


■>) 




-(7? + (72 - *(«))(7S + s )) + 7i(« - ^ («)) 

For P(z = 1, i), according to the result shown in 6 , we have 
P(z= l,s) = 2 7l72 

27i72« + A'(s)[7i72 + 71 (^(71 + 72 + s) 2 - 4 7 i 72 


(4) 


(5) 


-s-7i)]) (6) 


Finally, the relation between ip(t), the waiting time density, as defined in a CTRW 
scheme, and K(t), the memory kernel in Eq (1) 22 , in the Laplace domain reads 
K{s) = sip(s)[l -V>(s)] _1 . 

We show the results, obtained via Tauberian theorems 18 , for the asymptotic 
long time system’s behavior in two cases: when the waiting time function has a 
short or a long time tail. We assume that, when s <C 1, tp(s) ~ 1 — Bs" with 
0 < v < 1 for the case of a long tail, and o = 1 for the short tail case. In the case of 
short tail waiting time densities we have B =< t > a ds • Consequently, in this limit 
K(s) 

Considering the different possibilities we have three cases: (i) 7 i > 72; (ii) 
7i <725 (hi) 71 = 72 = 7- 
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fer^& ( S +a,,7 ‘- 1 * )) ]‘- <7> 


'{ 1+ B(7i- 


> 71 < 72: In this case, both < r 2 (i) > plane and P{z = l,t), show t 
exponential decay. 

► 7i = 72 - 7 


<r2(t)> ,_1-(rf (+4ai ^ (11) 


. _2,.w 4(B7i7 2 ) 2 ai il-2i/ , An. _.2_ ( 71 -72) 3 ^-, 

< r (1) (71 -72) 2 r(2(i - 1 .))* +4Bw ‘“‘Txfr7r‘ 


71 = 72 = 7 Here we have different asymptotic behaviors depending on the 
range of values of v. 

<7 a W>„„ m ~ B/; g ( ° ) + [/) ^- + 4» 1 t. 0<,<\ 

, r 2/ f w (2a)5^ + 4 7 H 2 a, a_„ s 

<7 «)>„,. (B/f + 1) , < + 2 e r(T^j t ' --5 
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P{z = l,t) « 
P{z = l,t) - 

P{z = l,t) - 


BJ 7 

UVr + i)’ 
r (*-»0 


(16) 



Figure 1. Temporal evolution of P(2 = l,t), the probability distribution on the plane 2 = 1. 
Here we have adopted a = 0 = c*i = /?i = 1, 0 = 0.01, a = 50 and 71 = 1. The different curves 
correspond to 72 = 0.9 (continuous line), 72 = 1.0 (dashed line), 72 = 3.0 (dotted line), 72 = 5.0 
(dashed-dotted line). 


Now we show some of the results obtained numerically. As was discussed in 
previous works 6 > 7 , for general cases, the Laplace transform of (r 2 (s)) p i ane and 
P(z — 1, s) usually cannot be analytically inverted. As this occurs in the present 
case, we have been forced to employ a numerical inversion method. The efficacy of 
such a method was established in 6,7 , where it was shown that it is a reliable tool 
and that we can trust their results in those cases where analytical results are not 
accessible 23 . 

To describe the desorption dynamics from the surface we have used the follow¬ 
ing family of waiting time densities that has been extensively exploited in 

modeling non Markovian situations 28,18 . The form is 


V»(t) = 9a 


(tOat 


(17) 


where a is a positive integer (a = 1,2,3,..) and T(a) is the Gamma function. There 
are two parameters which characterized the function: a, called markovianicity para¬ 
meter, defines the degree of non markovianicity of the function (a = 1 corresponds 
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to the Markovian case, a ± 1 to the non-Markovian case); while the parameter 0 
is the “average desorption’s rate”. Also, as shown in 24 , the mean value of these 
waiting time densities is < t >= J 0 °° t dt — 6 ~ 1 . Hence, the “average des¬ 

orption’s time” does not depends on the a parameter, but is only function of the 
desorption’s rate 24 . 



Figure 2. Temporal evolution of {r 2 (t)) p i ane , the variance on the plane 2 = 1. Here we have 
adopted a = /3 = 1, ai = f}\ = 0.01, 6 = 0.01, a = 50 and 71 = 1. The different curves 
correspond, from top to bottom 72 = 0.2, 72 = 1., 72 = 1.2, 72 = 1.5, 72 = 1.7, 72 = 3., 72 = 5.. 

In Fig. 1 we show the temporal evolution for P(z = l,t) when a = (i = ai = 
Pi = 1, 6 = 0.01, a = 50 and 71 = 1, for different values of 72. It is clear the 
agreement between this numerical results and the asymptotic behavior indicated 
above, as well as in the case of Fig. 2 where we show the temporal evolution for 
(r 2 (t)) P ,ane. 

In order to analyze the long time tail case, we have consider the following des¬ 
orption waiting time density function (defined in the Laplace domain) 29 

= lTI|f ’ 0<l/<1 ( 18 ) 

However, as </> amounts to only a change in the time scale, we adopted 0=1. We 
have also fixed the parameters a, /?, 07, Pi and 71, all equal to one. 

In Fig. 3 we show the temporal evolution for P(z = 1, f), while in Fig. 4 we show 
(r 2 (t)) plane- Again the agreement with the asymptotic behavior indicated above is 
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apparent. 



Figure 3. Temporal evolution of P(z = 1, t), the probability distribution on the plane z = 1. Here 
we have adopted a = 0 = ai = pi = 1, 0 = 1. and 71 = 1, while we adopt u = 0.1. The different 
curves correspond to 72 = 0.8 (continuous line), 72 = 1.0 (dotted line), 72 = 1.1 (dashed-dot line), 
72 = 1.2 (dashed line). The inset shows the temporal evolution of P(z = l,t), the probability 
distribution on the plane z = 1. Here we have adopted a = /J = <*1 = /?i = 1, 0 = 1., 71 = 1 
and 72 = 0.8. The different curves correspond to v — 0.1 (continuous line), v = 0.5 (dashed line), 
v = 0.7 (dotted line). 


Summarizing, we have studied the evolution of particles making an effective 
diffusion on a surface. The diffusion is actually performed both, on the surface, 
and across the bulk surrounding the surface, resulting in the so called bulk mediated 
surface diffusion phenomenon. The main feature of this work was to present an 
analytical model for non Markovian desorption from the surface also including the 
effect of an external (normal to the surface) field, through a biased behavior in the 
normal direction. For the bulk that surrounds the surface we have considered that 
it is semi-infinite, and that the particles undergoes a Markovian motion there. 

We observed the influence of the both effects on the effective diffusion process at 
the interface z = 1 by calculating analytically, in the Laplace domain, the temporal 
evolutions of (r 2 (t)) p i ane , the variance, and P(z = 1, t), the conditional probability 
of being on the surface at time t since the particle arrived there at t = 0. We 
have chosen two families of non Markovian desorption waiting time densities and 
analyzed the numerical evaluation for {r 2 (t)) p i ane and P(z = 1, t). One desorption 
waiting time densities with a finite first moment, while the other corresponds 
to a waiting time density for desorption has an infinite first moment. We have 
been able to deduce the asymptotic behavior in both cases, determining regions of 
values of the parameter v, obtaining asymptotic sub-diffusive regimes, or cases 
where normal diffusion takes place. The numerical results are in agreement with 
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the indicated asymptotic ones. 



Figure 4. Temporal evolution of (r 2 {t)) p i ane , the variance of the position r = (x, y) on the plane 
z = l. Here we have adopted a = /3 = ai = /3i = 1, 71 = 1 and 72 = 10. The different curves 
correspond to v = 0.1 (continuous line), v = 0.5 (dashed line), v = 0.7 (dashed double dot line), 
v = 0.9 (dotted line). 


Finally, it is worth remarking here an important aspect of the present approach. 
Through the above results we have shown that the behavior of (r 2 (t)) p / a ne and 
of P(z = 1, t) axe strongly dependent on both, the desorption mechanism and 
the effect of bias. As the effective dispersion and the percentage of particles that 
remain in 2 = 1 are measurable magnitudes 17 they may be used to investigate the 
characteristic and fundamental parameters of the desorption processes. 
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The ability of fractals to mimic Nature has led to the widespread acceptance of fractal, 
and, beyond, multifractal models. Such models axe in the roots of new approaches in en¬ 
vironmental sciences for processing images displaying turbulent-like systems. This paper 
addresses the problem of detecting critical areas associated with convection in satellite 
meteorological images. The technique we propose takes information about the spatial 
domain and relies on general statistical concepts. Due to the turbulent character of the 
observed atmospheric systems, the multifractal approach is naturaly adopted herein to 
describe not only the geometrical properties of images but also the underlying physical 
phenomena involved. The multifractal formalism leads first to the classification of dif¬ 
ferent chaotic parts of systems according to their dynamical significance. It is further 
employed to extract the places at which convection takes place in the flow. It is shown 
that it finally allows the determination of information that would be otherwise hidden. 
Without any temporal information, this remote sensing technique has potential appli¬ 
cation to infer the convective-scale processes occurring in individual convective systems. 
More generally, it leads to new insights into the analysis of natural phenomena from still 
images. 


1 . Introduction 

It is now recognized that many processes in nature, engineering, science and eco¬ 
nomics exhibit complex scaling behavior 15 : some obvious examples are given by 
oceanographic and atmospheric phenomena 6 ’ 13 , other less evidently related systems 
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are finance markets 16 , topographic landscapes 11 or even heartbeat rythms 12 . This 
complexity in scaling is commonly reflected as a nonlinear irregular variability of 
patterns fluctuations across a broad range of scales 20,21 . Theoretical arguments 
have shown that turbulence is representative of such processes 2,7 . This has led to a 
growing interest in obtaining compact description and accurate prediction tools for 
turbulent-like systems. However, the analysis of turbulent experimental data is still 
regarded as strongly challenging: classical descriptions are based on Navier-Stokes’s 
or other chaos-spawning differential equations, for which inverse and direct prob¬ 
lems are extremely demanding; they do not supply with a satisfactory quantification 
of the nonlinear variability in multiple scaling 15 . To overcome these limitations, 
the concept of multifractals has been developed to provide a mathematical model 
that embraces the irregularities that are, more generally, generic to the evolution 
of dynamical systems in Nature 15,18 . The multifractal formalism mainly assumes 
that local singularities exist within the systems and are arranged in a complicated 
mesh of different scale-invariant (fractal) structures. Detailed discussions on the 
multifractal nature of fluid turbulence can be found in the literature 6,7 ' 2 °. 

In this context, quantification of atmospheric flow patterns as recorded by me¬ 
teorological parameters, besides helping prediction of weather and climate, also 
provides a model for turbulent fluid flows. In particular, the improvement in the 
latest years of the technology for observing the Earth from the space has given 
rise to a growing interest in the developpement of new signal processing tools de¬ 
rived from thermodynamical concepts and their application on satellite images 3,s . 
Indeed, for most of the large-scale processes, statistics can only be obtained from 
satellite observation - and especially infrared (IR) images - because only this kind 
of data can cover the range of time and space scales involved in atmospheric phe¬ 
nomena 1,1Q . The objective of the present work is to show how the multifractal 
scaling formalism can be: (i) applied to process satellite images in order to extract 
meaningful meteorological patterns; (ii) further extended in order to give an inter¬ 
pretation to these patterns with regard to the underlying geophysical phenomena. 
We precisely focus on the characterization of the dynamics of convective systems 
(CS) in satellite IR images. Such knowledge is of great interest for a number of 
climate applications - such as general circulation models - as CS are mainly re¬ 
sponsible for hard weather situations like rainfalls and thunderstorms 1 . However, 
the analysis of their life-cycle is particularly challenging due to their multifractal, 
intermittent structure: evidence of scaling in space and time of clouds has been 
demonstrated in many previous studies 5 ' 9,13 . Multifractal geometry appears natu¬ 
rally as the suitable approach to perform such analysis, as we expect any quantity 
defined on the atmospheric flow to behave in an ergodic way, and even more to 
define a multifractal structure 2 ' 20 . Indeed, it has already provided various tools for 
the investigation of cloud properties: multifractal models are used 3 to analyze the 
textural roughness of clouds; the multifractal cascade phenomenology is adopted 5 
to identify convective-scale processes in CS; it is also used 13 to classify measured 
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rain fields with respect to the nature of the observed clouds; multifractal temporal 
fluctuations associated with selfsimilar multifractal spatial patterns are used 20 for 
rain areas detection; multifractal analysis of singularities is performed 8 to extract 
the main thermal fronts of CS. Recently, a new method for the assessment and 
tracking of pluviometry in CS in still IR images has been proposed 23 . The main 
underlying idea 8 is that strong transitions in the signal are related with the dy¬ 
namics of the flow. The streamlines of IR data are first identified by a multifractal 
singularity analysis; a proxy image that simulates pure horizontal advection is then 
derived from these streamlines; finally, from the comparison of both original and 
proxy images, convective areas of the flow are localized, and further identified with 
purely raining places. It appears that the analysis of the flow can be reduced to the 
characterization of some singular points derived from the multifractal formalism. In 
this paper, based on the assertion that forms visualized as still images account for 
the motion, we develop and evaluate this approach to the problem of motion charac¬ 
terization. The multifractal formalism 23 allows to identify the ” hidden sources” for 
the process, providing critical information about the flow evolution and the nature 
of the underlying motion: these sources correspond to areas where the (2D) image 
motion field is divergent, or, equivalently, where the (3D) flow is convective. 

The paper is organized as follows. In section 2, we review the multi fractal model 
for extracting meaningful patterns in IR images and for reconstructing a proxy 
image. In section 3, we relate this model with the hypothesis describing advective 
motion and we develop the formalism of the sources. In section 4, we compare the 
results with a physically-based optical-flow model and we provide an interpretation 
to the sources regarding the underlying phenomena. As a conclusion, we give the 
natural continuation to this work for further validation/use of the model. 

2 . Multifractality help to decipher complex image patterns 

Multifractality is a property of turbulent-like signals which is present in very dif¬ 
ferent physical systems 7 . It is generally reported on intensive, scalar variables of 
chaotic structures. In the following, we present one of the possible formalisms used 
to characterize multifractality, that was introduced in 24 , and apply it on IR images. 

The multifractal structure of a signal I can be assessed by defining at, any par¬ 
ticular point x a measure p in the way 24,25 : 

ti{B r {x)) = f dy\VI\(y ), (1) 

JB r (3) 

where the norm of the gradient |V/| is weighted over all the points in the ball D T {x) 
of radius r around x, and observing local power-law scalings a : 

fi(B r (x)) &a(x)r h(x K (2) 


“Note that the exponents h(x) in eq. (2) could be rewritten h(x) + d where d is the dimension of 
the space so that they will be the same for measures of the same degree of regularity disregarding 
the dimensionality 25 . 
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Figure 1.: Left: IR image acquired by the geostationnary satellite Meteosat displaying a typical 
CS. Right: representation of singularity exponents; the darker the pixel, the lower the value of this 
exponent at that point. Lower values (i.e. most singular points) are found near the boundaries. 


That power-law behaviour implies that there is no privileged scale of observation: 
the signal is self-similar as all the dependence in the scale r is contained in the 
factor r h( - x \ not a(x). Let then F/, 0 be the level-set associated to a given value h n : 

F ho = {£ : h(x) = ho} , (3) 

hence, all points x in the space are arranged according to the local singularity ex¬ 
ponent h(x) they are assigned. The family of subsets Fh are of fractal character 
(i.e. they exhibit the same geometrical structure at different scales) due to the scale 
invariance of the function h and provide a multifractal splitting of the image. Theo¬ 
retical foundations are fully discussed elsewhere 25 . Besides, this decomposition has 
a strong dynamical meaning: one can deduce the statistics of changes in scale just 
knowing the dimensions of the fractal components 18 . Let notice that, in turbulence 
theory, an expression similar to eq. (1) defines the local dissipation of energy in the 
flow; thus, the decomposition Fh can be regarded as the geometrical representation 
of the multifractal cascade of energy between the different scales 2,9 . However, the 
current approach does not depend on the specifics of the cascade phenomenology, 
the geometrical attributes of the multifractal hierarchy are analyzed directly. 

In the context of image processing, the point x refers to the pixel, the vari¬ 
able I(x) is the graylevel value and the measure p expresses the local variability of 
graylevels around x. Performing a multifractal decomposition with eq. (2) finally 
amounts to locally quantify the strenght of the transition the signal undergoes 
around each pixel. In practice 25 , to overcome the difficulties due to the image dis¬ 
cretization, the gradient I(x) is simply estimated by finite difference at the distance 
of one resolution box (one pixel) b . The singularity exponents arc computed t hrough 
a log-log linear regression on the wavelet transform 14 of the measure, which has 
been proven to also exhibit multifractal behaviour 25 , and not of the measure itself. 


b This definition is derived from the linear increment formalism originally employed for the analysis 
of multifractal behavior in turbulent flows 7 . 



Figure 2.: Left: MSM estimated on the sample IR image of Fig. 1; pixels of the MSM are assigned 
a non-white graylevel according to the orientation of the gradient over this set (grey, negative; 
black: positive). Right: reconstruction out of the data defined on the orientated MSM. 


When considering meteorological IR images (Fig. 1, left), the graylevel intensity is 
identified with thermal IR radiance, measured on higher layers of the atmosphere, 
which is a typical turbulent variable following a complicated pattern. Namely, it 
was shown 8 that IR images are of multifractal nature. In Fig. 1, right, we can sec 
a typical segmentation induced by the spatial distribution of the singularity expo¬ 
nents. The Fh splitting consists of an edge-like most singular manifold surrounded 
by manifolds of decreasing singularity as we move away from it 25 . 

In the multifractal decomposition, one set, called the Most Singular Manifold 
(MSM), is of particular importance: the manifold F 00 associated to the minimum 
value for the singularities hoc < h(x) V x, whose existence is ensured by the multi¬ 
fractal theory 24 . The MSM has usually a fractal co-dimension of 1 and resembles 
the edges or contours of the objects in the case of natural images 25 or relevant dy¬ 
namical points in other systems 8 . In Fig. 2, left, the MSM gathers the pixels where 
the discontinuities in graylevel are the more appreciable, thermal fronts indeed. The 
MSM is known as the most informative set in the image 8 , but its most relevant 
property is found in its interpretation as the origin of the multifractal hierarchy 22 . 
It is possible (under certain statistical hypothesis) to reconstruct the multifractal 
completely from the values of the gradient restricted to the MSM, V/^: 

I(x) = g®VI hoo (x) (4) 

with a particular reconstructing kernel g defined in Fourier space (see Fig. 2, right). 

3 . Multifractal sources provide relevant motion information 

When dealing with large-scale phenomena in the atmosphere (scales of a few tens of 
km or more), one usually appreciates several elements that configure the dynamics: 
almost 2D motion, vertical stratification and also a strong influence of Earth s 
rotation. Indeed, transport in the atmosphere is dominated by advection, and is 
quasi-horizontal. However, there are a number of different physical mechanisms 
by which vertical transport may be present 1 . In this context, we will sec that 


Figure 3.: Left: reduced image computed from the orientated MSM in Fig. 2. Right: representation 
of the norm of the source field; gray pixels in the sources stand for values close to the average, 
while zeros are represented by black pixels and poles by white pixels. 


the multifractal formalism introduced above can be further completed in order to 
extract the places where the flow is not contained in the surface of the image. 

Indeed, it is possible to obtain more information from the MSM than just recon¬ 
structing the signal from it. The detection of the MSM constitutes the stumbling 
block to infer the properties of the local motion in the flow. It was shown 23 that 
detecting the MSM is equivalent to detect the main instantaneous (2D planar pro¬ 
jection of the) streamlines of the flow. The underlying hypothesis is that vertical 
movements (mainly inside clouds) modify the spatial variability of temperature 10 . 
More precisely, as the MSM consists of flow lines, the situation where the flow is 
purely advective correspond to the situation where the image gradient is perpen¬ 
dicular to the MSM lines with constant modulus. Namely, when temperature is 
advected by the flow, it is diffused horizontally, i.e. inside planes parallel to the 
image surface and it is possible to track its movement; however, when temperature 
is convected, there is a temperature flow transversal, at an unknown rale, to (.he 
plane of image acquisition. Thus, for any scalar quantity advected in a region, 
its average across that region is conserved; more mathematically, the gradient is 
perpendicular to the streamlines, and with constant modulus. These observations 
lead to the concept of a Reduced image R: in eq. (4), the actual gradient over the 
MSM Vlhn is replaced with a vector field consistent with the advection hypothesis 
i.e. perpendicular to the MSM and of constant modulus (and with, by convention, 
the same orientation as the original gradient) 8,23 . Comparing original and proxy 
signals, we can deduce the temporal evolution of the flow. A simple way to assess if 
the advective assumption holds in a given area is to verify if the gradient along the 
MSM is constant and perpendicular to the MSM, i.e. if / and R coincide in this 
area. Where I differs from R, convective movements (perpendicular to the plane of 
the image) may be present (see Fig. 4). 

In order to propose a more quantitative criterion, we use the formalism of sources 
introduced previously 23 . Let first define the vectorial measure /fy associated to 
the signal I as follows. For any subset (region in the image) A , the vectorial 
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Figure 4.: Comparison of original IR image and its reduced counterpart on two excerpts extracted 
from Fig. 1 and 3 resp. Left: the flow is dominated by advection, the images are rattier similar 
Right: convective activity inside the CS is present, the images are very different. The range of 
graylevels was expanded in order to show as many details as possible. 


measure pi {A) is given by: 

PM) = J^dyS7I(y) (5) 

and an analogous definition for the measure pR associated to the reduced signal R. 
The absolute variations 19 of both pi and pR are multifractal (in the sense of eq. (2)) 
with the same singularity exponents h(x), that is c : 

\Pi\(Br(x)) ~ \p R \(Br(x)) ~ . (6) 


Consequently the two measures are absolutely continuous with respect to each 
other 19 , and for that reason one measure can be represented as the integral with 
the other measure of an appropriate vectorial density S. We define the vectorial 
field of Sources as the Radon-Nykodin derivative 19 : 


S(X) ! 


r— *0 fJ, R (B r (x)) 


(7) 


where the limit of the ratio is taken at decreasing scales r. Technically, we make 
use of the commutative algebra of complex numbers to compute S: the 2D vector 
fields defined through eq. (5) are seen as complex fields and the vectorial division 
in eq. (7) is assumed in the complex plane. The sources are not of multifractal 
character, as the singularities of I have been removed by dividing by those of /?; 
as a consequence, they are displaying a completely different, more regular structure 
(Fig. 3, right). It was shown 23 that they enable to easily characterize advection and 
convection, avoiding the need of considering regions separately and without having 
to process a sequence. Over advective-dominated areas S will be a constant, as the 
image and its reduced counterpart coincide. On the contrary, on areas dominated 
by vertical transport, the variations of S will be large. Taking into account that 
roughly V7 « 5 Vf? (the sources represent the matrix field of transformation 
between the gradients of I and R), advection means that S is a constant, real 


c In theory, R attains the most uniform intensity 
structure of I. 


ipatible with the multifractal 
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number. For convection, on the contrary, the highest discrepancy between V/ and 
VR will happen when one of them vanishes while the other is still finite: hence, the 
strongest convection appears in the zeroes and poles of 5. 


4. Validation and comparison with temporal information 

In order to validate the role of the sources, we present evidence on the connection of 
sources with the dynamics of the atmospheric flow. For that purpose, we compare 
the features extracted through the estimation of the source field with the description 
of motion obtained through velocity fields. 

Fig. 5 shows two IR samples belonging to a common sequence of images dis¬ 
playing cloudy systems that are known to involve convective activity, namely CS 1 . 
Hence, some temporal information can be inferred. The most common method for 
meteorological sequence analysis consists in estimating the apparent motion through 
dense velocity fields computation. In particular, using optical flow (OF) method¬ 
ologies 4 , it is possible to assign a velocity vector to each point in the image using 
conservation hypothesis and regularisation constraints. Even if these hypotheses arc 
seldom satisfied in the case of natural fluid flows, OF may provide a reasonable ap¬ 
proximation of apparent motion. If we compute the divergence of the resulting flow, 
we observe (see Fig. 5) a very good correspondence of large divergence values with 
singular focii in the vector field of sources. The sources correspond to the purely 
convective area of CS, dominated by vertical motions 23 : singularities of the motion 
field (that can be connected to convection) are related to the spatial distribution of 
flow transport across scales. This result is quite promising: sources are computed 
using one image only, contrary to OF that requires sequence of images, and provide 
however relevant, comparable information about the temporal evolution of CS. 


5. Conclusion 

In this paper, we have developed and validated a multifractal technique to detect 
and locate critical areas of meteorological structures, associated with 2D divergent 
motion or, equivalently, 3D vertical transport, that are displayed in satellite IR 
images. Due to the fact that the evolution of atmosphere involves fluid phenomena, 
the multifractal formalism, derived from thermodynamical concepts, appears as the 
most suitable approach to analyze such data. 

The main result of this study regards the characterization of the, so-called, 
source field and its specificity. Sources reveal the gradual deviation from advec- 
tion to convection because the multifractal structure is completely determined by 
the properties of the MSM. Once we know how to translate any constraint on the 
dynamics (as for instance advection) to the MSM, we can construct a reduced sig¬ 
nal verifying that constraint, and then compare it with the original signal. The 
Radon-Nikodym derivative will remove the part that both signals share (multi¬ 
fractal structure), highliting their differences (dynamics). The multifractal scheme 
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Figure 5.: Comparison of the information provided by velocity field estimation and source field 
computation on IR images. Selected samples were extracted from a common sequence displaying 
the temporal evolution of the CS of Fig.l. Left: divergence of the velocity fields estimated with 
OF approach; non null divergent areas are represented in black (positive) and white (negative); 
average gray values correspond to areas with (close to) null divergence. Right: norm of the sources, 


proposed does not require of any continuity or smoothness hypothesis (as OF meth¬ 
ods, for instance) and offers an instantaneous information derived from still images 
(in opposition to OF, that require a sequence of images sampled at a rate fast 
enough). The power of multifractal analysis lies in the existence of a hierarchy 
which is conserved by the dynamics and which can then be used to know more 
about it. Besides, any other problem in which a multifractal structure has been 
reported is a good candidate for a multifractal analysis of this kind. Sources can 
be calculated in order to characterize the underlying dynamical properties. More 
generally, they provide a new way to analyze and interpret many natural systems. 
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The iteration of complex function can generate beautiful fractal images. This paper 
extends the existing iteration methods and tries to find a new way to generate fractal 
image. We present a novel method based on the iteration of the distance ratio with two 
points, which classifies the points according to their distance ratio iteration convergence 
speed. By using this method, we get a 4-dimension fractal set. Firstly, this paper proves 
the condition of distance ratio convergence and gives an inverse iteration layered method 
to render the distance ratio fractal. Secondly, taking the quadratic complex function for 
example, we render the distance ratio fractal image by projecting the distance ratio 
fractal set into 2-dimension plane. Finally, we analyze some properties of distance ratio 
fractal image and prove its boundary is the Julia set. Comparing with traditional escape 
time algorithm, the new method uses iteration of two points instead of one point to 
generate more complex structure, which is different from existing fractal image. 


1. Introduction 

Since the introduction of fractal by Mandelbrot \ fractals have experienced con¬ 
siderable success in quantifying the complex structure exhibited by many natural 
patterns and have captured the imaginations of both scientists and artists. Fractal 
art is an algorithmic approach for producing computer-generated art. Many re¬ 
searchers perform research on the generation method of fractal 2 and draw many 
beautiful images 3 . 

The iteration of complex function can generate beautiful and complex fractal 
images, such as M-J sets using escape time algorithm. However, it is difficult to 
render the image of convergence region using escape time algorithm due to its one 
point iteration. The iteration points converge or diverge very fast, so it is hard to 
get their convergence property and to draw the image in the convergence region. 
Hooper 4 adds some function transform to escape time algorithm to draw internal 
structures, but it cannot distinguish the convergence speed of the iteration point 
either. 
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This paper presents a novel method based on the iteration of distance ratio with 
two points, which can generate a new type fractal, named as distance ratio fractal. 
We research the iteration property of distance ratio and prove its convergence condi¬ 
tion. Based on the convergence property of distance ratio, we generate a fractal set 
with its convergence time. Using the inverse iteration layered method, a distance 
ratio image can be rendered. As this image has unlimited details and self-similarity 
structure, it is a fractal image. We analyze some properties of distance ratio fractal 
image and prove its boundary is the Julia set. 

The paper is organized as follows; Section 2 introduces some mathematical 
notation; Section 3 states the definition of distance ratio and proves its convergence 
condition; Section 4 takes the complex mapping f(z) = z 2 + c as an example and 
states the algorithm for rendering the distance ratio image; Section 5 proves some 
properties of distance ratio fractal image; Finally, section 6 summarizes the paper. 


2. Basic Concepts 

This section reviews some of the basic mathematical notation that will be used 
throughout the paper. 

In mathematics, a contraction mapping on a metric space ( X , d) is a function / 
from X to itself, with the property that there is some real number s < 1 that for 
all x and y in X, d(f(x),f(y)) < sd(x,y). The number s is termed as contractivity 
factor. 

An important property of contraction mappings is given by the Banach fixed- 
point theorem. The theorem guarantees the existence and uniqueness of fixed-points 
of contraction mappings of metric spaces, and provides a constructive method to 
find those fixed points. 

Let (A, d) be a non-empty complete metric space. Let / : X —* X be a contrac¬ 
tion mapping on X. Then the map / admits one and only one fixed-point x* in 
X which means f(x*) = x*. Furthermore, this fixed-point can be found as follows: 
start with an arbitrary element Xo in X and define a sequence by x n = f(x n - 1) for 
n = 1,2,3... This sequence converges, and its limit is x*. The following inequality 
describes the speed of convergence: 

k n 

d{x*,x n ) < y—- -d{xi,x 0 ) 

In this paper we discuss the contraction mapping on C (space of complex numbers). 

Julia sets are fractal shapes defined on C. Given an iterated map of the complex 
plane to itself, the Julia set can be defined as follow 2 : 

Let /h') be the /c-fold of function /. If f^(z) = z for some integer p > 1, we 
call z a periodic point of /, the least p satisfies /( p ) (z) = z is called the period of 
/. Let z be a periodic point of /, with (f^)' (z) = A. If |A| > 1, call z is repelling. 
The Julia set J(/) may be defined as the closure of the set of repelling periodic 
points of /. 
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Let z* be the fixed-point of function /, define A(z*) = {z £ C : f( k \z) 
:*,(&—> oo)} as the basin of attraction of fixed point z*. 

Suppose z* is the fixed-point of /, then the attraction basin of z* is J(/). 


3. Distance Ratio and its Iteration 


Let / : C —> C be an analytic function, for any z\ ^ z 2 £ C, define the distance 
ratio L(zi,z 2 ) as follow: 


L(zi,z 2 ) 


l/(*i) ~ /(* 2 )l 

\zi - z 2 \ 


(1) 


Perform the iteration on the initial points Zi and z 2 , let z[ n+1 ^ = f(z[ n ^), 
^(ra+i) _ = 0,1, • • ■, and define the distance ratio after n-times iteration 

L(")(Z!,Z 2 ) as: 


H n \ Zl ,z 2 ) 


( 2 ) 


L(zi,z 2 ) represents the contractive rate of initial points distance after itera¬ 
tion. According to the definition of derivative, when zi approaches z 2 , L(zi, z 2 ) ap¬ 
proaches the derivative of /(z 2 ). Changing the way of approach into iteration, the 
initial points will approach the fixed-point if / is a contraction mapping; L^ n \z\, z 2 ) 
will converge to the derivative at the fixed-point if n approaches infinity. It will be 
proved by following theorem: 


Theorem 3.1. If function f has a fixed-point z* and A(z*) is the attraction basin 
of z*, for any zi and z 2 in A(z*), it follow 

Jim L«(z 1 ,z 2 ) = |/'(z*)| (3) 


Proof: For zi and z 2 
z*. Let Az = zf> - 

Jim LW (zi, z 2 ) = ■ 


are the points in A(z*), we have Jim z^ —► z* and Jim z ( 2 ki —> 
• z^ —► 0, compute the iteration of distance ratio: 


lim zf +1) - lim zf +1) 

fc—>oo 1 fc—oo 1 

Jim z[® - Jim 


lim 

| Az—.0 


f(z* + Az) - z* 
Az 


i/'coi 


The iteration times that L(zi,z 2 ) approaches the derivative, are different for 
different initial points. Thus, the approaching times are related to initial points 
and the following theorem is stated: 


Theorem 3.2. For a specified threshold e , 3k* £ N , if k > k* 

|LW(zi,z 2 )-|/ , (z*)|| <e 
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Proof: For any z £ C, the iteration sequence = f(z^ n ^), n = 0,1,- 
obtained. Let s be the contractivity factor. 

!*<”+■> - 2 <”>| - |/ (;:<">) - / (*<~»)| < »| 2 <”> - z<-“\ <...<•» ’ - 

| z w- 2 <»>|<x;|,<‘ +i >- 2 <‘>|<i;» 

Let m —> oo , then 


Let | - z* | < e , the iteration times can be decided according to 

n < e(l - s) 

Suppose the iteration times are k\ for z\ and k 2 for z 2 , the threshold are £1 for z\ 
and £2 for z 2 , let k > max(ki,k 2 ), z[® = = z *+ e 2°\ l e l ^ l e i^ _e 2^l> 

it follows: 


\H k \z u z 2 )-\f'{z*)\\ = 


/(*•+.<*>)-,( 2 * +£ «) 

/(**+£)-/(*•) 

_(fc) _(fc) 

e l " s 2 

£ 


f (** + e[ k) ) ~ / (** + 4 fe) ) -f{z*+e) + f{z*) 


a ( e W_ e M_ e ) 


s^~ 1 (zi -z 2 )| 


And the iteration times can be estimated through 

< d£!_L2> 

“ 1 + e 

Define k* in Theorem 3.2 as the stabilizing times. For a specified threshold e, 
L(zi, z 2 ) can approach to the derivative in limited times. Obviously, stabilizing 
times are related to the choice of initial points and are different for the points 
located in different regions. 


4. Distance Ratio Fractal Image of Quadratic Map 

Taking the quadratic function f(z) = z 2 + c as an example, we perform researches 
on the relationship between the stabilizing time k* and the initial points by iterating 
the distance ratio. It shows that the method results in a fractal set. And we will 
analyze its properties. 
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4.1. Distance Ratio of Mapping f(z ) = z 2 + c 

To compute the distance ratio of f(z) = z 2 +c, we choose any two points z\ (x'i, ;yi) 
and Z2(x2,y2) with zi 7^ 02, then compute their distance after one time iteration. 

1/(21) - f{z 2)1 = V( x i - Vi - A + vl) + (2^12/1 - 2x2«/ 2 ) 2 

= y [(xi - a ; 2 ) 2 + (yi - 1/2) 2 ] [(xi + x 2 ) 2 + (yi + y 2 ) 2 ] 

= |2l - Z2| |2l + 2 2 | 

Therefore, the distance ratio T(zi, Z2) — \z\ + Z2\. Perform the iterations on the 
distance ratio, we have: 

^lirri L^(zi,Zi) = |^lim z[ k ^ + ^lim zjp | = 2\z*\ = \f'(z*)\ 

Figure 3 shows the fluctuation of distance ratio during iterations. We can see 
T(zi, 22) approaches the derivative at the fixed-point after seven iterations. 


v~ 


Figure 1. The fluctuation of distance ratio in iterating 


4.2. Distance Ratio Zone 

Based on the discussion of Section 3, the stabilizing time k* is different for dif¬ 
ferent initial points. We put the points with the same stabilizing time to one 
set, named as zone(k). Therefore, the set of all convergence points consists of 
zone(0), zone(l), ■ ■ ■ ,zone( 00). We name the set generated this way as the Dis¬ 
tance Ratio Set(DRS). 

According to Eq.l, the distance ratio is computed by two points zi(xi,yi) and 
22(2:2,2/2)- So we have a 4-D set (xi,yi,X2,y2)- In order to render fractal image in 
2-D plane, we have one point fixed as the fixed-point and let the other point change. 
The definition of zone(k ) and DRS is as follows: 
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Supposing z is a complex number and £ is a small real number, we say that 2 is 
fc-level if z meets the following condition: 

| L^\z,z*) - |/V)l| > e, | H k \z,z*) - |/V)l| < £ (4) 

The set consisting of all the fc-level points is termed zone(k). The set of all the 
converged points is called the distance ratio set (DRS), which can be divided into 
some zone(k), like: 

DRS(f) = [J zone(k ) (5) 

fc=o 

From above definition we can see that the points in zone(k) approach the derivative 
after at least fc iterations. The relationship of the points in the neighbor zone is 
stated by the following theorem: 

Theorem 4.1. If f has inverse mapping, for any z in zone(k + 1), there exists z' 
in zcme(k), which satisfies / _1 (z') = z. 

Proof: For any z £ zone(k + 1) according to the Eq.l ,we have, 

I LW(z,z*) - |/V)|| = \L {k) (r\z'),z*) - |/'(z*)l| = | L^\z,z*) - |/V)l| > £ 
\H k+1 Hz,z') - |/V)lj = j L( k+1 \f~\z'),z*) - |/'(z*)l| = | lM(z,z*) - |/V)lj < e 


So z' satisfies the definition of zone(fc), z' G zone{k). For any z in zone(fc), 
f(z) £ zone{k — 1), therefore zone(k) turns into zone(k — 1) in one iteration, 
viz. f(zone(k)) = zone(k - 1). 

From Theorem 4.1, performing inverse iteration on zone(k) will generate 
zone(k + 1). Starting with zone( 0) and repeating this process, we can compute 
zone(l), zone(2), ■ ■ ■ ,zone(n) . Combining the entire zone, we will get the whole 
distance ratio set. 


4.3. Rendering Method 


We may have a very complex image by drawing different colors in different zones of 
the distance ratio set. We name this image as the distance ratio fractal image(DRF). 
This section will introduce the rendering method of DRF. Firstly, we discuss how 
to compute zone( 0) . 

Based on Eq.l and Eq.3, we have: 


\f(z)-f(z*)\ , 

I*-2*1 


< £ 


Let f(z) = z 2 +c and solve above inequation, it follow: 


2\z*\ - e < \z + z*\ < 2\z*\ + e 



So zone{ 0) is a ring between two circles centered at —z*, and the radius of one circle 
is 2\z*\ — e, the other is 2\z*\ + e . 

We compute zone( 0) firstly, then get zone(l),zone(2) ■ ■ • by performing inverse 
iteration, and so on to get the whole distance iterated image. We call this method 
Inverse Iteration Layer Method (IILM). The specific steps of the algorithm IILM 
are listed as follows: 

(1) Specify the max iteration times n and let k = 0 ; 

(2) Compute the zone{ 0) ; 

(3) Perform inverse iteration for all points in zone(k), which will result in the 
zone(k +1) ; 

(4) Draw zone(k) with different colors that can be got by k; 

(5) If k < n , then k = k + 1, go to (3); 

Figure 2 shows the rendering process of DRF. The whole process goes from inner 
layer to outer layer, like blooming flower. It is also feasible to choose any of the 
layers to render. 

Figure 3 shows some DRF with typical parameter , e = 0.0000001 and n = 50. 
Fig 3.a shows the image with very small |c|. The image is approximate to a circle; 
many “buds” sequences are located around the center. The number of “buds” 
of each layer increases greatly and approaches infinity. In Fig 3.b, parameter |c| 
increases moderately and the structure of the image is diverse. The “buds” structure 
partly changes to the “hair” structure, and these two structures are co-existing. The 
border of the image is a simple curve. The value of |c| is big in Fig 3.c, which results 
in huge change of the image’s border and the “buds” structure fully turns into the 
“hair” structure. 

It can be seen from above images that the DRF have following features: 

There are little changes in the center area, while the surrounding areas have clear 
detailed structure, and the further area is located from center, the more complex 
the mini structure is; “buds” structures exist in the image and its number increases 
as its distance from center increases. With the increase of c, the “buds” structure 
turns into the “hair” structure; if c is big enough, these “hair” structures will twist 
together. 


5. The Properties of Distance Ratio Fractal 

In this section, we will prove the image rendering in above sections is fractal image. 
Firstly, we prove the border of the DRF is a Julia set generated by mapping /. 

For any point z in DRF, based on Theorem 3.1, if the iteration of distance 
ratio converges to the derivative at fixed-point, the initial point must converge to 
fixed-point, viz. 
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ie(0) H-h zone( 4) (e) zone(O) H-(- zone( 5) (f) zone( 0) + • • 

Figure 2. The rendering step of DRF 



(a) c = 0.0000001 (b) c = 0.04 + 0.057t (c) 

Figure 3. DRF with difference parameter 


0.2 + 0.038i 


So z is located in the attraction basin of z * and DRF is the attraction basin of the 
fixed-point. 

The border of the attractive basin for the fixed-point of / is the Julia set formed 
by mapping / 2 , thus the border of the DRF is a Julia set of mapping /. Therefore 
the algorithm of rendering DRF can be adopted as a new method to draw the inner 
structure of Julia sets. And many conclusions of Julia sets are adaptable. For 
instance, there is an attractive fixed-point, if c is located in the heart-shape line 
s = e'6 (1 - e i 9/2) /2, (0 < 9 < 2tt) 2 , the DRF can be created. 
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In the following, we state DRF has unlimited details and self-similarity structure. 
Based on Theorem 3.2, the smaller the threshold e is, the bigger the stabilizing 
times k is; when e —► 0, k —► oo. As f~ 1 (z) = ±y/z - c is multi-value mapping, 
during process of inverse iteration, the number of points in zone(k) increases doubly 
with the increase of k. According to above, DRF has unlimited details. Based on 
Theorem 4.1 we have f(zone(k+l)) = zone(k), so DRF has self-similarity structure. 
Therefore, it is a fractal image. 

The method to render DRF can be extended to many mappings. From above 
discussions, the distance ratio will converge when mapping has an attractive fixed- 
point; the detailed structure of each layer will increase doubly if the inverse function 
of the mapping is multi-valued. Based on these observations, we make the supposi¬ 
tion that the mapping satisfying above conditions can create distance ratio fractal 
image. Figure 4 is an iteration image of another polynomial function . There will 
be further study of its properties in future works. 


ifW*- 



Figure 4. The distance ratio image of g(z) = z 3 + 0.2 + O.li 


6. Conclusion and Future Works 

This paper investigates the distance ratio and its properties. If the complex function 
is contraction mapping, the iteration of distance ratio will converge to the derivative 
at the fixed-point. By rendering the initial points with different color according 
to their iteration convergence times, a fractal image is obtained. The image has 
unlimited detail and self-similarity. Primary analysis shows its properties and proves 
that its border is the Julia set. The paper researches the properties of DRF in 2-D 
plane; Future works will do the following: 

(1) render the 3-D DRF and analysis their properties; 

(2) investigate the properties of DRF generated by other functions; 

(3) perform further study of the concrete structure of the fractal images. 
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We investigate graph-directed iterated function systems in mixed Euclidean and p-adic 
spaces. Hausdorff measure and Hausdorff dimension in such spaces are defined, and an 
upper bound for the Hausdorff dimension is obtained. The relation between the Haar 
measure and the Hausdorff measure is clarified. Finally, we discus an example in R x Q 2 
and calculate upper and lower bounds for its Hausdorff dimension. 


Keywords-. Graph-Directed Iterated Function System, p-adic Spaces, Hausdorff Dimen¬ 
sion, Affinity Dimension 


1. Introduction and Setting 

The main focus of this article is the following situation: Assume that a (finite) family 
(fi 1; ..., Cl n ) of subsets of a locally compact Abelian group X, the topology of which 
is assumed to be generated by a metric, is implicitly given as the unique solution 
of a graph-directed iterated function system (GIFS). Can we define and calculate 
the Hausdorff measure and Hausdorff dimension of these sets, and determine their 
relation to the Haar measure in X? 

In the following, we assume that the space X is given by 

X = R r xC J xQ Pi x ••• xQ Pfc , (1) 

i.e., as a product of non-discrete locally compact fields (we shall expand on Q p 
below). We call the number 

dim metr X = r + 2- s + fc (2) 

the metric dimension of X (also see Section 3). 

The organisation of this article is as follows: To keep everything as self-contained 
as possible, we briefly review p-adic spaces in Section 2. In Section 3, the relation 
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between Hausdorff measure and Haar measure on X is clarified. Iterated function 
systems on X are introduced in Section 4. We define the affinity dimension for a 
GIFS and show that it is an upper bound for the Hausdorff dimension of the sets 
flj. We also discus a condition for which we obtain a lower bound for the Hausdorff 
dimension. In the last Section, we explore a GIFS in K. x Q 2 - 


2. p-adic Spaces and their Visualisation 

An algebraic number field K is a finite field extension of Q lying in C, i.e., it is a 
simple extension of the form K = Q(A). The integral closure of Z in an algebraic 
number field K is called the ring of algebraic integers o K of K. An ideal p of the 
ring o K is called prime if the quotient o^/p is an integral domain. A key theorem 10 
in algebraic number theory states that every (fractional) ideal of o K in K can be 
uniquely factored into prime ideals. 

Let K* be the multiplicative group of non-zero elements of K. A surjective 
homomorphism v : K* —» Z with v(x + y) > min{u(x),u(y)} (and the convention 
u(0) = oo) is called a valuation 18 . Every prime ideal p yields a valuation of K, 
called the p-adic valuation u p , and these are all possible valuations: For x € K 
let v p (x) = v p (xo K ) (i.e., xo K is the (fractional) ideal generated by x) where a 

v„ (a) v p (a) 

(fractional) ideal a has the unique factorisation a = p x 1 • ■ -p t 1 into prime 

ideals p 1 ,... , p^. 

Given a p-adic valuation v p , one obtains an ultrametric absolute value (or, more 
precisely, a non-Archimedean absolute value) by ||x|| p = r)~ v <> ^ for some 77 > 1 
(where ||0|| p = 0). The completion of K = Q(A) with respect to such a p-adic 
absolute value yields the p-adic number field Q p , which is a locally compact field. 
We note that the completion of Q itself w.r.t. the prime ideal pZ yields the p-adic 
numbers Q p . 

We define the p-adic integers Z p = {x G Q p | ||x|| p > 0} and the related ideal 
m p = (x G Q p | ||x|| p > 0}. Then Z p is a discrete valuation ring , i.e., it is a principal 
ideal domain that has a unique non-zero prime ideal, namely tn p . Furthermore, 
the residue field k p = Z p /m p is finite, and the choice rj — [Z p : m p ] in the above 
definition of the p-adic absolute value yields the so-called normalised p-adic absolute 
value (which has nice properties w.r.t. the Haar measure on Q p , see Section 3). 

An element 7 r which generates m p , i.e., m p = 7 rZ p , is called a uniformizer. By 
the uniqueness of m p , the non-zero ideals of Z p are given by 7 r m Z p (m G N 0 ). If 5 is 
a system of representatives of k p (including 0 for simplicity), every element x G (Q> p 
can be written uniquely as a convergent series (w.r.t. the p-adic absolute value) 

with Sj € S and m G Z. If x G Z p , then one can take m = 0 and we simply write 
(with obvious meaning) x = s 0 s i s 2 • • •• 
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One can visualise Z p (and also Q p ) as a Cantor set 16 . For example, if we take 
Q 2 , every x € Q 2 can be written as x = Y^jL m s j where S = (0,1}. Therefore, 
Z 2 can be identified with the set of all 0-1-sequences, i.e., Z 2 = {0,1} N °. But this is 
also a coding of points in the Cantor set a , and points which are close in the Cantor 
set are also close w.r.t. the 2-adic metric (also, both the Cantor set and Q 2 are 
totally disconnected). In Section 5, we will use the Cantor set to visualise sets in 
Z 2 , where (for reasons of representation) we take a factor of \ instead of | in the 
construction of the “Cantor set” (of course, one then obtains the whole interval 
[ 0 , 1 ]). 


3. Haar and HausdorfF Measures 

Given an Abelian topological group G, a measure fi, on the family B of Borel sets 
in G is called a Haar measure if it satisfies the following conditions 6,12,5 : 

HI /x is a regular measure. 

H2 If C is compact, /i(C) < oo. 

H3 /u is not identically zero. 

H4 p is invariant under translations, i.e., n(B + t) = n(B) for all B G B and 
teG. 


Haar measures are unique up to a multiplicative constant. They are obtained by a 
so-called “Method I Construction” 12 . 

The Haar measure on X is the product measure of the Haar measures of its 
factors. We remark that the (1-dimensional) Lebesgue measure on R and the 2- 
dimensional Lebesgue measure on E 2 ~ € are Haar measures. We also note that 
we have for a Haar measure fi on R, resp. C, resp. Q p 

• n(aB ) = |a| • if a G R and B C R. 

• n(aB) = M 2 • fi(B) if a G C and B C C. 

• K a B) = IMIp • V-(B) if a 6 Q p and B C Q p (where || • || p denotes the 
normalised p-adic absolute value). 


On the other hand, X is also a separable metric space, where we take the maxi¬ 
mum metric d, OQ , i.e., for x, y 6 X with 

x = (xi,...,x r , 4+ x + i ■ 4+i> • • •, 4+. + i ■ xfl 8 ,x r+a+ 1 ,..., x r+a+k ) (4) 
(where x y , ... ... ,4+ s € R, while x r+8+j G Q Pj for all 

1 < j < k) we have 

<4o(z, V) = maxflx! - j/il,. • ■, |x r - y r |, |x^j - |,..., |x^ + } a - |, 

kr+l - Vr+ll • . . > l4+s - vi+sl lkr+ s +l ~ Vr+s+1 ll Pl , • • • , 


l Indeed, the Cantor 


is given by |*= f • «j (i) J I G {0,1}}. 
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Therefore, we can define the diameter of a set B C X by diam(B) = 
supj. ygn d^ix, y) with the convention diam(0) = 0. Then, the measure ob¬ 
tained by the so-called “Method II Construction” 12,17 from the set function t(B) = 
[diam(jB)] d is a measure and called the d-dimensional Hausdorff measure h^. 

Generalising Theorem 30 in Ref. 17, we can show that the two measures are 
related as follows. 

Theorem 3.1. Let the space X he given as in Eq. (1), and let d = dim metr X. Then, 
the d-dimensional Hausdorff measure h^ is a Haar measure. Furthermore, 
equals the Haar measure constructed as product measure where we assign measure 
1 to the unit interval (in R) resp. to Z p (in Q p ). □ 

As usual, it is clear that h^(B) is non-increasing for a given subset B C X 
as d increases from 0 to oo. Furthermore, there is a unique value dim Hd B, called 
the Hausdorff dimension of B, such that h^(B) = oo if 0 < d < dim Hd B and 
h^ (B) = 0 if d > dim Hd B. 

Note that one can see from this property that Hausdorff dimension is a metric 
concept rather than a topological one 7 (therefore we have chosen the name metric 
dimension; the (topological) dimension of X is r + 2 • s, because p-adic spaces Q p 
are totally disconnected). 


4. Graph-Directed Iterated Function Systems 

Let us consider the following subspace C of linear mappings 1 * from X to X: For each 
T £ £, there are numbers Oj,..., a r+a+k such that 

T( x ) = T((Xj,.. . , % r +s+k)) = ( a l ‘ x l> ■ • • i a r-M+fc ' ^r-M+fc)’ (6) 

where x v ... ,x r ,a 1 ,... ,a r e R, while x r+1 ,... ,x r+s ,a r+1 ,... ,a r+a € C and 
X r+s+j> a r+s+j e (1 ^ 3 ^ ^)- 

We now look at the family (complex numbers a r+1 ,..., a r+s taken twice) of the 
r + 2 • s + k numbers 


( l®il> • ■ •) l a rl> l a r+l l» l a r+ll> l a r+2l> • ■ • > l a r+s-lli 
l a r+J> l a r+sl> ll a r+*+lllp,»' • • > ll a r+s+fcllp fc )> (?) 

called the singular values of T. We order them in descending order oq > a 2 > 
... > oc r+28+k , where (aq, .. -,a r+2s+k ) is a permutation of (la^,..., ||a r , +s+fc || Pfc ). 
We are only interested in maps T € C which are contracting (oq < 1) and non¬ 
singular (oy +2 s+fc > 0). We denote the subspace of non-singular and contracting 
maps of C by £. 


b One can also consider more general linear mappings 2 ; the ones considered here then correspond 
to the case where the coordinate axes and the principal axes coincide. 
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The singular value function <& 9 (T) of T G £' is defined 2,3 for q >0 as follows: 

( 1 if q = 0 

&(T) = i a, • a 2 •... • «*,_! • af J+1 if j - 1 < g < j (8) 

l ( a i' a 2 ' • • • ’ a r+2 S +fc) 9/(r+2s+fe) ifq>r + 2- s + fc 

Then, $ 9 (T) is continuous and strictly decreasing in q. Moreover, for fixed q, the 
singular value function is submultiplicative, i.e., $ 9 (T o U) < <f> 9 (T) ■ $ 9 ([/) for 
T, U G £'• Note that we have $ 9 (T n ) = [$ 9 (T)] n . 

We now look at a graph-directed iterated function system (GIFS) (1 < i < n): 

n. = U U Jfw (f) 

* =1 

where Fy is a (finite) set of affine contracting mappings, i.e., /ju (x) = T^ (<) (x)+t^ e) 
with T , t) G C and t {l) G X. A GIFS can be visualised by a directed multi-graph 

/ij Jij 

G ! Q j, where the vertices are the sets fij. If F i} - 0, we draw |F^-| directed 

edges from flj to fl^, labelling each edge with exactly one of the maps f-lj\ We 

denote by F the matrix 0 F = (|F ij -|) 1<i j -< n (with the convention \0\ = 0) and by 
p(F) its spectral radius. 

We define the path space E°° as the set of all infinite paths in the graph 
along directed edges that start at some vertex. Each path (and its starting 
point) is (uniquely, maybe after renaming) indexed by the sequence of the edges 
<jj = (cj 1 w 2 • • ■) it runs along. We also define the sets F^ 0 ) = 0 (paths of length 
0), and the set E of all paths of length l that start at Q. i and end at Qj (then 
Wi G (Jm=i F im and u> e G (Jm=i F mj)- We also set E& = U?=i U"=i E lf (ah paths 
of length l), F fin = (J^> 0 F W (all finite paths) and E* = F fin U F°°. 

For ui G F fin and vj G F*, we denote by ljw the sequence obtained by concate¬ 
nation (or juxtaposition) if wn G E*. If u) is a prefix of w, i.e., w = w ..., we write 
u> < w. By w A ra we denote the maximal sequence such that both (wAo) < u> 
and (u) A vj) < vj. We can topologise E°° in a natural way using the ultrametric 
d{u> , vj) = 7 y _ l wACT l for some q > 1. Then E°° is a compact space and the sets 
N(vj) = {wG E°° \zu < u>} with w G F fin form a basis of clopen sets for E°°. 

For u = (w 1 ...uJ e ) G F fin , we define T u = o ... o (with T 0 (x) = x), 
i.e., we are only interested in the linear part of each map cu^x) = T u (x) + t w . 
By the “Method II Construction” with the set function T q (N( w)) = <3> 9 (T W ) (with 
r 9 (0) — 0), we obtain a measure on F°°. Then, we can generalise Proposition 
4.1 of Ref. 2. 

Proposition 4.1. For a GIFS (with strongly connected directed graph), the follow¬ 
ing numbers exist and are all equal: 


(Oj.«„)• 


: This is also the adjacency matrix of the graph 
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( 1 ) infI E **(TJ< 00} = sup{ ? | E &(Tj = oo}. 

u€£ r ‘ n Gj6E ri " 

(2) in% [!/(«) (JS°°) = 0} = sup{£? 11/(9) (£~) = oo}. 

(3) the unique q > 0 such that* 


lim 


E ® 9 ( r J 


l/« 


( 10 ) 


We denote the common value by dim aff G^ n Q ^ and call it the affinity dimension 
(or Falconer dimension,! of the GIFS. □ 


By a covering argument, we get an upper bound for the Hausdorff dimension of 
the sets fl it compare Proposition 5.1 of Ref. 2 and Theorem 9.12 of Ref. 3. 

Proposition 4.2. If i/(^(E°°) < oo, then ft(9)(fi j ) < oo for all 1 < i < n. In 
particular, we have dim Hd n i < dim aff G^ ni) n ^ for all 1 < i < n. □ 

In general, it is difficult to decide whether equality holds in this last inequality 
for a self-affine GIFS, although in a certain sense equality is the generic case - at 
least in R r (see Theorem 5.3 of Ref. 2 and Theorem 9.12 of Ref. 3). And contrary 
to the well-studied self-similar case (where aq = ...= a r ) in M r , even the open set 
condition e (OSC) does not ensure the equality sign (cf. Ref. 11 and Examples 9.10 
& 9.11 in Ref. 3). 

We now define a second singular value function 'b q (T) of T € C for q > 0 as 
follows 4,13 : 


{ 1 if q = 0 

a r+2s+k ' • • • ' a r+2s+lc-j+l ‘ a r+2s+fc-j+l '^3 <Q Sj ( 11 ) 

(aq ■ a 2 ■... ■ a r+2s+fe ) 9/,(r+2s+fe) ifq>r + 2'S + A: 

Again, lJ v (T) = [3> 9 (T -1 )] -1 is continuous and strictly decreasing in q, but super- 
multiplicative for fixed q. Just as in Proposition 4.1, we define the lower affinity 
dimension 

dimaffG^ nj = inf {« I E < °°} = SU P{« I E ^ 9 ( T J = °°} ( 12 ) 


of the GIFS. Then, with the help of the “mass distribution principle” (see Proposi¬ 
tion 4.2 in Ref. 3), we obtain the following lower bound for the Hausdorff dimension 
of the sets compare Proposition 2 of Ref. 4. 


d As a reminder: p{F) denotes the spectral radius of the matrix F. 

e The OSC is satisfied if there exist disjoint non-empty bounded open sets (l/j,. .., U n ) such that 
U i 3 U? =1 Uy(f) gF with the unions disjoint. 
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Proposition 4.3. Let (fi 1; ..., Q n ) be the solution of a (strongly connected) GIFS 
II, = (J " =1 U/< ( ) € p where all unions are disjoint. If the sets (fij,..., Q n ) 

are also pairwise disjoint, then dim a ff G^ n ^ < dim Hd fl, for all 1 < i < n. □ 

We remark that this disjointness condition is often easy to check in the cases we 
are interested in, since p-adic spaces are totally disconnected. 

If the linear part of all maps fff is the same, i.e., T = X^. (<) for all i,j,I, we 
finally obtain the following theorem. 

Theorem 4.1. For a (strongly connected) GIFS with (unique non-empty com¬ 
pact) solution (flj,... where all maps fff have the same linear part T, the 

affinity dimension dim aff n , is given by the unique value q > 0 such that 

$ 9 (T) • p(F) = 1. The Hausdorff dimension of the sets is bounded by the affin¬ 
ity dimension of the GIFS, i.e., dim Hd < dim aff G (f2 )S7 ^ for all 1 < i < n. 
Furthermore, if the unions in the GIFS are disjoint and the sets (fl lt ..., G n ) are 
pairwise disjoint, the Hausdorff dimension of the sets fl i is bounded from below by 
the lower affinity dimension of the GIFS, i.e., dim a ff G^ Q ^ < dim Hd Cl i for all 
1 < i < n, where dim aff G^ n ) * s Qi ven by the unique value q > 0 such that 
W{T)-p(F) = 1. . . " □ 

5. An Example 

Our motivation for this work are so-called “Rauzy fractals” 15 , which are used to 
prove pure pointedness of the dynamical system of certain 1-dimensional sequences 
over a finite alphabet, obtained by a substitution rule. “Rauzy fractals” yield a ge¬ 
ometric representation 14 (or so-called windows for models sets 1 ) for such sequences. 

Here, we look at the substitution a t—> aaba, b i—> aa (we obtain a two-sided 
infinite sequence by applying the substitution repeatedly (we denote the zeroth 
position by |): a | a h-> aaba \ aaba i-> ... aaaba \ aabaaabaaaaaba...). Prom such 
a substitution, one can obtain a GIFS (see the above literature 15,14,1 and references 
therein), in this case in the space R x Q 2 : 

= T(0 o ) U T(Cl b ) U T(n o ) + \t x U T(Q b ) + U T(fiJ + 1 2 
f \ = T(Q a ) + t 1 (13) 

where T((x 1 ,x 2 )) = (k-x x ,X-x 2 ), t x — («, A), t 2 = («+l, A+l), « = 3 ~^ « -0.562 
and A — « 3.562, which in the 2-adic expansion starts as A = 01101 .... We 

have |k| = j, ||A|| 2 = \ and p(F) = A, and therefore the affinity dimension 1 
dim aff G (q n ^ = 2 = dim metr R x Q 2 . Indeed, one can show that the Haar measure 
of the sets Ll a and H b is positive and the intersection fl a n Ll b has Haar measure 0. 

f We also have dim aff G^ n ) = 2, but the sets f2 a and fl b axe not disjoint. Therefore Proposi¬ 
tion 4.3 does not apply here. 
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It is more interesting to calculate the Hausdorff dimension of the boundaries dCt a 
and dQ b . For the boundary, one can also derive a GIFS with the same contraction 
T. This is possible, because the above GIFS for (Q a , fl 6 ) can be dualised 9 to obtain 
a point set equation for point sets (X a ,X b ): 

X a = T~ 1 (X a ) U T~ 1 (X a ) + T~ 1 (^t 1 ) U 

T~ 1 (x b ) + T~ 1 (t 1 ) u r -1 (x a )+r -1 (t 2 ) (14) 

= T~ 1 (X a ) U T~ 1 (X a ) + T~ 1 (^t 1 ) 

where T~ 1 ((x 1 ,x 2 )) = (£ • x u j • x 2 ). Starting this iteration with X a — {(0,0)} = 
X b , one obtains a fixed point for (X a , X b ) and one can show that J = (X a + fij U 
( X b + Cl b ) is a tiling with the prototiles Q, a and Q, b of the whole space 1 x Q 2 (for 
purely Euclidean spaces, this is now well established 8 ). With the help of this tiling 
J, one obtains the following GIFS for the boundary: 

“(a,6,0) = ^“(o.o, 1)) 

S (6,o,0) ; ^“(a.a.-l)) + *1 

S (a,M) = r ( H (a,a,-l)) + *1 U T (U T(2^^) 

“(a, 0 ,- 1 ) = r (“(o, 0 , 1 )) U r (“(o,a,l-£)) + 5*1 U T ^ = ‘(a,b,l-^ + 5*1 

+ K (5) 

H (o, o,l-|) =T ( H (o,a,-l))+*2 

“(a,6,1-$) = T (“(o,o,4-l)) U T (“(t,o,^-l)) 

H (b,o,4-l) =T ( S (a,o,!-*)) +*1 U T ( S (o,M-^))+*1 

Here, a = fl a D + (1 - |, 1 - •£) and similarly for the other sets. The 
boundaries are therefore given by 


= “(a,6,0) U “(a,a,l) U “(a,a,-l) U “(a,a,$-l) U “( 0 , 0 ,l-$) U “(a,6,1-$) 

- H (6o0) U S (6q ^_ 1) . (16) 

To obtain a strongly connected GIFS which fulfills the disjointness condition from 
the GIFS in Eq. (15), we observe that E (a60) = E (6o0) , E (ool) = U 

5( a 61 _ A) and = E^ o U E( o>60 y So we arrive at the GIFS 


S (a,6,0) 

= r ( S ( a , 

l-$) } 

U T ( H (o,m- 

(a,a,$— 1) 

= T ( H (a,o 


+ & 

q U T( E 

(a,o,l- $) 

= T ( S ( fl , a 

7-1)^ 

+ t 2 

U T( £ ( , 

“(«,6,l-$) 

= T ( S (o,o 

fr-iP 

U %,i 

“(6,a 4-1) 


i-#)) 


U T{ S (i 


For this GIFS, the spectral radius p(F ) equals 2. 
tain dim aff E - , 


(17) 


Consequently, we ob- 
1.1675 and 
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dim _ _ i=l- Using the total disconnectedness of Q 2 , 

(“(-..0 .“(>,a,*V 

one can show that the disjointness condition for the sets in Eq. (17) holds, wherefore 
these are the upper and lower bounds for the Hausdorff dimension of the boundaries 
dQ a and dfl b . We end this article with pictures of the GIFS in Eq. (17) and of the 
sets Q a , Q b and their boundaries. 



Figure 1. The directed graph G^. 




, associated 1 

). 


1 the GIFS inEq. (17). 
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Multiplicative processes and multifractals have earned increased popularity in applica¬ 
tions ranging from hydrodynamic turbulence to computer network traffic, from image 
processing to economics. We analyse the multifractality of the recently proposed point 
process models generating the signals exhibiting 1 /f 13 noise. The models may be used 
for modeling and analysis of stochastic processes in different systems. We show that 
the multiplicative point process models generate multifractal signals, in contrast to the 
formally constructed signals with 1/f 0 noise and signals consisting of sum of the uncor¬ 
related components with a wide-range distribution of the relaxation times. 


1. Introduction 

Multifractal models are used to account for scale invariance properties of various 
objects in different domains ranging from the energy dissipation in turbulent flows 1 
to financial data 2 . Healthy human heartbeat intervals exhibit multifractal proper¬ 
ties rather than being fractal for a life-threatening condition, known as congestive 
heart failure 3 . Cerebral blood flow in healthy humans is also multifractal 4 . 

Scaling behavior has become a welcome careful description of complexity in 
many fields including natural phenomena, human heart rhythm in biology, spatial 
repartition of faults in geology, as well as human activities such as traffic in computer 
networks and financial markets. The multifractal formalism has received much 
attention as one of the most popular frameworks to describe and analyse signals 
and processes that exhibit scaling properties, covering and connecting both the local 
scaling and the global one in terms of sample moments. 

The purpose of this paper is to analyse the multifractality of signals exhibiting 
1/fP noise generated by different techniques and, especially, of the point processes 
with 1 //^ power spectral density 5,6 . 

First of all, however, we will analyse the multifractality of the signal constructed 
by the inverse fast Fourier transform 7 . Using this method we can generate signals 
with any desirable slope (3 of the power spectral density S(f) ~ l//' 3 . 

We calculate a generalized qth order height-height correlation function (GHCF) 
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F q (t) defined as 8 

F q (t) = (\i( t '+t)-i(t')n 1/q , (i) 

where the angular brackets denote the time average. The GHCF F q (t) characterizes 
the correlation properties of the signal /(f), and for a multiaffine signal a power-law 
behavior like 

F q {t)~t H ■> (2) 

is expected. Here H q is the generalized qth order Hurst exponent. If H q is inde¬ 
pendent on q, a single scaling exponent H q is involved and the signal I(t) is said to 
be monofractal 8 . If H q depends on q, the signal is considered to be multifractal. 




Figure 1. a) Power spectral density and b) the generalized Hurst exponents H q versus 1/q in the 
scaling regime 1 < t < 1000 for the slopes 0 = 1 (open circles) and 0 = 2 (open squires). The 
signal of 10 6 points was generated and averaged over 10 realizations, c) and d) show GHCF F q (i) 
versus time t for the same parameters 0 = 1 and 0 = 2, respectively. 


In figure 1 a) we present a power spectral densities with the different slopes (5 
and in figure 1 b) we show the Hurst exponents, calculated from GHCF using linear 
regression dependence on 1/q of the signals formally constructed by the inverse 
Fourier transform. In figure 1 c) and d) corresponding GHCF F q (t) versus time t 
are shown. We see that Hurst exponent H q does not depend on q, which indicates 
that the signal is monofractal. 
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2. Stochastic multiplicative point process 

In many cases the intensity of some signals or currents can be represented by a 
sequence of random (however, as a rule, mutually correlated) pulses or elementary 
events A k (t — 4), 

I(t) = J2 A k{t-tk). (3) 

fc 

Here the function A k ((f>) represents the shape of the k pulse making an influence 
on the signal I(t ) in the region of the transit time 4- We will be interested in 
the processes with the power-law distribution of the power spectral density at low 
frequencies. It is easy to show that the shapes of the pulses mainly influence the 
high frequency, / > 1/A t p , with A t p being the characteristic pulse length, power 
spectral density, while fluctuations of the pulse amplitudes result, as a rule, in the 
white or the Lorentzian but not 1/f noise 9 . Therefore, we restrict our analysis to 
noise due to correlations between the transit times 4- In such approach we can 
replace the function A k (t - 4) by the Dirac delta function and then express the 
signal as 

7(f)=a£«5(f-4), (4) 

with d being an average contribution to the signal of one pulse. This model 5 also 
corresponds to the flow of identical objects: electrons, photons, cars, and so on, and 
is called the point process model. Point processes arise in different fields, such as 
physics, economics, cosmology, ecology, neurology, seismology, traffic flow, signaling 
and telecom networks, and the Internet (see e.g., papers 9,10 and references herein). 

The power spectrum of the point process signal is described completely by the 
set of the interevent intervals T k = 4+1 — tk- Moreover, the low frequency noise is 
defined by the statistical properties of the signal at a large-time-scale, i.e., by the 
fluctuations of the time difference 

fc+g-l 

A (k-, q) = t k+q - 4 = Ti (5) 

i=k 

at large q, determined by the slow dynamics of the average interpulse time 
fk(q) = A(k;q)/q between the occurrence of pulses k and k + q. Quite generally 
the dependence of the average interevent time f k may be described by the general 
Langevin equation. The Langevin equation may be written down in the actual time 
t or, equivalently, in the space of the occurrence numbers k with the drift coefficient 
h(f k ) and a multiplicative noise g(f k )£(k), 

= Hh) + g(f k )€(k). (6) 

Here we interpret & as a continuous variable while the white Gaussian noise £(fc) 
satisfies the standard condition 


mm'))=s(k-k') 
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with the brackets (...) denoting the averaging over the realizations of the process. 
We understand the equation (6) in Ito interpretation. 

Transition from the occurrence numbers k to the actual time t in Eq. (6) may 
be fulfilled using the relation dt = f^dk 11 . 

The particular sequence of the interevent times r k may be superimposed by 
some additional noise or stochasticity, e.g., r k may be determined by the Poisson 
distribution 

P(r k ) = i-e '~ Tk/fk (8) 

Tfc 

with the slowly, according to Eq. (6), changeable average interevent time f k . Such 
additional stochasticity do not influence the long-range statistical properties and 
the low frequency spectra of the process. Therefore, further we will restrict the 
analysis to the processes generated by Eq. (6) and will identify r k with f k . 

2.1. Power spectral density 

The point process is entirely defined by the occurrence times t k . The power spectral 
density of the point process (4) may be expressed as 

W) = r'i2o(l )= T ‘™ 

(9) 

where ti and tf are initial and final observation times, T = tf — 1 is the 

whole observation time and ui = 2nf. Here A; m i n and k max are minimal and maximal 
values of index k in the interval of observation T and the brackets (...) denote the 
averaging over realizations of the process. 

For the interpulse intervals described by the Langevin equation (6) we use a 
perturbative solution in the vicinity of r k . After replacing the averaging over k by 
the averaging over the distribution P k {rk ) of the interpulse times r k , we have the 
power spectrum 6 

S(f) = 2P —pr- /^(TTfcJHele-^-^erfcv^wl — dr k) (10) 

v 7r / J T k 

o 

where I and f are the averages of the signal and the interpulse times, respectively, 
and x — nfr k /h(T k ). 

The replacement of the averaging over k and over realizations of the process by 
the averaging over the distribution of the interpulse times r kl P k (r k ), is possible 
when the process is ergodic. Ergodicity is usually a common feature of the stationary 
process described by the general Langevin equation. 

According to Eq. (10) the small interpulse times and the clustering of the pulses 
make the greatest contribution to 1//^ noise. The power-law spectral density is 
very often related with the power-law behavior of other characteristics of the signal, 
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such as autocorrelation function, probability densities and other statistics, and with 
the fractality of the signals, in general 12 . Therefore, we investigate the power-law 
dependences of the drift coefficient and of the distribution density on the time r*, 
in some interval of the small interpulse times, i.e., 

h{r k ) = irl Pk(T k ) = CV fc tt , r min < r fc < r max , (11) 

where the coefficient 7 represents the rate of the signal’s nonlinear relaxation and 
C has to be defined from the normalization. 

The simplest and the well-known process generating the power-law probability 
distribution function for 77 is a multiplicative stochastic process with 9(17) = 
and d' = 2 p - 1, written as 6,13 


Tk+l =Tk+ 7 Tfc' 1 1 + £fc. 


( 12 ) 


Here 7 represents the nonlinear relaxation of the signal, while 17 fluctuates due to 
the perturbation by normally distributed uncorrelated random variables £7 with a 
zero expectation and unit variance and <r is a standard deviation of the white noise. 

Eq. (12) is the difference (discrete) version of the differential equation (6). On 
the other hand, it is the generalization of the simple autoregressive model of 1// 
noise 5 (see also Eq. (15)) and represents quite general evolution of the interevent 
time with the nonlinear drift hfa) = 7r^ -1 and the multiplicative noise c TT%£k, 
resulting in the l/f 13 noise and power-law distribution (11) of the interevent time 
Tfc with the exponent a = 27 /<t 2 - 2 p. Indeed, the power spectrum for the process 
(12), when 7/(7rr^) / < 7/(7T T 2 ~f ), is 6 


= (2 + a)(/3-l)a a rQ9-l/2) n^ 1 J_ 

- t 2 + q ) sin(7r/3 /2) W/ fP’ 


where 


(13) 


(14) 


For /i = 1 we have a completely multiplicative point process when the stochastic 
change of the interpulse time is proportional to itself. Another case of interest 
concerns /1 = 1/2, then we have the Brownian motion of the interevent time with 
the linear relaxation of the signal / ~ a/r. 

Figure 2 represents the spectral densities (9) with different slopes f3 of the signals 
generated numerically according to Eqs. (4) and (12) for different parameters of the 
model. We see that the simple iterative equation (12) with the multiplicative noise 
produces the signals with the power spectral density of different slopes, depending 
on the parameters of the model. The agreement of the numerical results with the 
approximate theory is quite good. 
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Figure 2. Power spectral density (9) vs frequency of the signal generated by Eqs. (4) and (12) 
with the parameters a ) fi = 0.5, a = 0.02 and different relaxations of the signal 7 = 0.0001 (open 
circles), 0.0002 (open squares) and 0.0003 (open triangles); and b) = 1, a = 0.1 and 7 = 0.008 
(open circles), 0.01 (open squares) and 0.012 (open triangles). We restrict the diffusion of the 
interevent time in the interval r m i n = 10~®, r m ax = 1 with the reflective boundary condition at 
r m i n and transition to the white noise, 17 +1 = r max + <T£fc, for r*. > r raax and 100 realizations 
with 10® tk points each were used. The solid lines represent the analytical results according to 
Eq. (13). 


2.2. Multifractal point processes 

The multifractal formalism has received much attention recently as one of the most 
popular frameworks to describe and analyse signals and processes that exhibit the 
scaling properties. 

Fractality of the point process can be investigated by transition from the point 
process to the stochastic signal I(t), using the rectangular constant area pulses, 
instead of the Dirac delta functions. The stochastic signal will have the same fractal 
properties as the origin point process. 
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Figure 3. a) Generalized height-height correlation function F q (t) versus time t for the signal (4) 
and (12) with p = 0.5, t = 1, a — 0.02, 7 = 0.0002, and q = 0.5,1,1.5,..., 5 from bottom to 
top. b) The generalized Hurst exponents H q versus l/q in the scaling regime 1 < t < 1000 for 
the f = 1 and fj. = 0.5, a = 0.02, 7 = 0.0002 (open circles); fi = 0.5, a = 0.02, 7 = 0.0003 (open 
squares); *1 = 1 , a = 0 . 1 , 7 = 0.008 (open triangles). 
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In figure 3 a) we present the GHCF as a function of the time interval t, and in 
figure 3 b) we show the Hurst exponents calculated from GHCF using the linear 
regression dependence on 1/q for different parameters p, a, and 7. We observe 
the clear multifractal behavior since the slopes of the log-log plot of GHCF are 
depending on q. 

Another interesting case is a sequence of transit times with random increments 
of the time intervals between pulses, 17 = Tk-\ + ere*,. It is natural to restrict in 
some way the infinite Brownian increase or decrease of the interpulse times 7>, e.g., 
by the introduction of the relaxation to the average interpulse time f rate 7. So, 
we have an additive point process 

r k = T k -i - nrin-i - t) + (T£ k . (15) 

This model generates the process with 1/f noise 5 , and may be useful for modeling 
and analysing different systems (see references in paper 6 ). Introduction of the 
reflective boundary condition at r m i n > 0 avoids the formation of clusters and leads 
to 1/f 2 noise. 



Figure 4. a) Power spectral density and b) the generalized Hurst exponents of the additive point 
process (15) with the reflecting boundary condition at r m in = 0.1 in the scaling regime 1 < 
t < 1000. The signal of 10 6 points was generated with the parameters f = 1, <j = 0.001, and 
7 = 0.000001. 


In figure 4 a) we present a power spectral density of the additive point process 
(15) with the reflecting boundary condition and in figure 4 b) we show the gener¬ 
alized Hurst exponents. We observe the multifractal behavior of the additive point 
process. 


2.3. Monofractality of the white and the Gaussian noises 
It is well-known 9 that the point processes with the interevent time 77 distributed 
according to Poisson distribution 

T k /f 


P{T k ) = -e 1 


(16) 





284 


I# 2 

=z:. . 



r' 

—===:: 

sT 0 

: _ . . 

io° 

rizzzziz — -■ 




...... 1 


b) 


10 3 10 4 10 5 '°' 1 0 0.5 1 1.5 2 

1/q 


Figure 5. a) Generalized height-height correlation function F q (t) versus time t, and b) the gen¬ 
eralized Hurst exponents H q versus 1/q of the point process with interevent time Tk distributed 
according to Poisson distribution (16) in the scaling regime 1 < t < 1000. The signal of 10 6 points 
with the parameter f = 1 has been generated. 


generate the white noise, S(f) = const. 

In figure 5 a) we present the GHCF as a function of the time interval t and in 
figure 5 b) we show the Hurst exponents for the white noise. The Hurst exponents 
of the white noise are equal to zero. This demonstrates the absence of the scaling 
and that there is no correlation in time. 

Noise with the power-law spectral density 1// is often modeled as the sum of 
the Lorentzian spectra with the appropriate weights of a wide range distribution of 
the relaxation times T rel . The signal may be expressed as a sum of N uncorrelated 
components, 

jy 7raax 

I(t) = J2m= J 7, (17) 

where g( 7) is the distribution of the relaxation rates 7 = l/r re( , and every compo¬ 
nent Ii satisfies the stochastic differential equation 

= + ( 18 ) 

Here is the average value of the signal component I\ , &(t) is the 5-correlated white 
noise, (Cl(^)Ci' (^ x )) = — and <j; is the intensity (standard deviation) of the 

white noise. The steady-state solution of the stationary Fokker-Planck equation 
corresponding to Eq. (18) for each component // and the resulting signal (17) yields 
the Gaussian distribution densities, however, the power spectrum may be of the 
power-law form when a 2 (7)5(7) is constant or a power-law function 6 . 

In figure 6 a) we present a power spectral density of the sum of the signals with 
a wide range distribution of the relaxation times r rei and in figure 6 b) we show the 
Hurst exponents, calculated from GHCF using linear regression dependence on 1 /q. 
In the figures we observe Iff behavior of the signal noise and clearly see that Hurst 
exponent H q does not depend on q, which shows that the signal (17) is monofractal. 
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Figure 6. a) Power spectral density and b) the generalized Hurst exponents H q versus 1/q in the 
scaling regime 1 < t < 1000. The signal of 10 6 points was generated from 10 components with the 
parameters I = 20, cr 2 (7)5(7) = 10, and uniform distribution of lg7 with 7 values in the interval 
10~ 4 - 1. 


3. Conclusions 

The multiplicative (12) and additive (15) stochastic point processes may generate 
time series exhibiting the power spectral density S(f) ~ 1 /f 0 and show clear multi¬ 
fractal behavior, however, the formally constructed by the inverse Fourier transform 
signal, Poisson white noise (16) and Gaussian, Eqs. (17) and (18), signal with the 
power spectral density S(f) ~ 1// are monofractal. 

Therefore, the proposed 5 and generalized 6 point process models of 1 /f 0 noise 
may be used for modeling of stochastic multifractal processes in different systems. 
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Geographical distribution patterns in plants have been observed since primeval times and have been 
used by plant explorers to trace the origin of plants species. These patterns embody the effects of 
fundamental law-like processes. Diversity in plants has also been found to be proportionate with the 
area, and this scaling behavior is also known as fractal behavior. In the present study, we use fractal 
geometry to analyze the distribution patterns of wild taxa of cowpea with the objective to locate 
where their diversity would be the highest to aid in the planning of targeted explorations and 
conservation measures. 


1 Introduction 

Geographical distribution patterns in plants have been recorded by explorers since 
primeval time and such observations have continued throughout history. The oldest 
known plant exploration dates back to 1495 BC by the Pharaohs in the land of Punt 
(Somalia today) under the reign of Queen Hatshepshut who sent the explorer Nehsi in 
search of plant species native to Punt Land, such as frankincense to produce aromatic 
gum resin and other shrubs that produce myrrh [1]. Our present knowledge of 
geographical patterns of variation was established in the 1920s, following N.I. Valvilov’s 
work on centers of origin and diversity of cultivated plants [2]. These distribution 
patterns have been used extensively by the explorers to trace the origin and evolution of 
cultivated plants in the last 3 to 4 decades. Plant species exhibit these geographic 
distribution patterns within boundaries set up by ecological and evolutionary processes 
[2-5]. 

Common to these distribution patterns is the presence of fundamental law-like 
processes, which include among many others, laws of biological inheritance and 
evolution by natural selection [6, 7]. The relationship between the diversity and the area 
it occupies has been also found to follow a power-function relationship, in which the log 
values of diversity in terms of species’ richness and area produce straight lines in a plot. 
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Olof Arrhenius first proposed the mathematical description of this relationship in 1 920 
[8] and MacArthur and Wilson later recognized the species-area relationship in 1967 [9], 
in their theory of island biogeography. The theory also stipulates that the species richness 
is a function of both the size of the area and the proximity to sources areas [9]. This 
relationship has been recognized in recent years in the design of in situ conservation or 
reserve areas [10, 11] 

In the present project, we used fractals to study the geographical patterns of plant 
species distributions modeled as fractal geometrical “objects” [4] and we then measured 
their attributes such as size and shape. Prior to defining the different attributes for the 
different taxa, the geographical patterns were generated by predicting the probability 
distributions of where the taxon could be found based on available location records and 
climate data. 

2 Material and Methods 


2.1. Plant species used in the study 

The present study was conducted by modeling the pattern of distribution of the wild 
cowpea (Vigna unguiculata (L.) Walpers), which encompasses the 13 wild taxa in Table 
1 [12], Some of these wild varieties are widely distributed, such as Vigna unguiculata 
subs, dekindtiana var. dekindtiana, while others are rare and confined to limited areas. 
Most of the varieties are located in the south-eastern part of the African continent. This 
area harbors the highest degree of variation among the taxa studied, and can be 
considered a center of diversity of cowpea wild forms [11, 12]. Interestingly, this area 
also falls within a biodiversity hotspot as designated by Biodiversity International [13]. 


Table 1: Taxa of wild cowpea and their status in terms of abundance. 


Taxon 

Sub-species 

Variety 

Status 

i 

dekindtiana 

dekindtiana 

very common 

2 


ciliolate 

very rare 

3 


affinis 

fairly common 

4 


congolensis 

restricted 

5 


grandiflora 

very rare 

6 


hullensis 

restricted 

7 

pubescens 


fairly common 

8 

protracta 


fairly common 

9 


kgalagadiensis 

fairly common 

10 


rhomboidea 

restricted 

II 

tenuis 


common 

12 


oblonga 

common 

13 


parviflora 

very rare 


2.2. Defining the extent of geographical distributions (geographical range) 

The data on wild cowpea taxa of Padulosi [12] consist of records from botanical 
explorations (herbarium specimens and inventories) and plant genetic resources 




explorations. Each record has a number of attributes, including the geographical location 
(0 coordinates (x iw yi) where the taxon was originally sampled. From these records, the 
dot distribution maps were produced using the geographic coordinates (x, y,) (Figure la). 
Because the dot distribution maps represent only the locations that have been previously 
sampled, they are likely to be biased by the locations’ accessibility to explorers. 
Therefore we generated the probability surfaces (Figure lb) where the taxon would likely 
be found based on climate data using FloraMap, a geographical information system 
(GIS) application developed by the International Center for Tropical Agriculture. 
FloraMap defines areas that are likely to contain specific desired adaptations, taxa, or 
habitats of interest, and areas that are potentially under-represented in the original data 
[14,15], 

The climate at each location (/') was extracted from a built-in climate database of 
FloraMap, and used as a calibration set to calculate a new climate probability model. 
Prior to the generation of the predicted distribution maps, calibration can be carried out 
to normalize rainfall pattern and determine the number ( k ) of orthogonal components 
(climate variables) through Principal Components Analysis (PCA). FloraMap then uses 
the Student’s t-Test to calculate the probability that a map pixel belongs to the calibration 
based on the equation for multiple dimensions with the k independent (orthogonal) 
variates from the sampled data [14]: 



The probability surface or grid is then generated through interpolation based on the 
inverse distance weighting method as per the equation: 

±*M 

Zo=—, - (2) 

!>/<? 

where z 0 is the interpolated value, n refers to the number of sampled plus predicted 
neighboring data points with its z,- value and d t represents the distance between z n and z,. 

These probability surfaces are also shape-files, with each pixel defined as a square 
polygon that can also be used in a GIS environment to determine if there are any 
correlations with other environmental factors. These data can be overlaid with other 
information or grid data such as soils or and natural vegetation to assess the distribution 
of the species and monitor its distribution in space and eventually its fluctuation in time. 

2.3. Geographical pattern analyses using fractals 

Once the probability map for each taxon was obtained, the fractal dimensions were 
measured using the box counting method (D b ), the information method (D e ), and the 
fragmentation method (£)/) [16]. 
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The box counting method was based on the equation: 

mdi-js: ( 3 ) 

where N(d) is the number of boxes and d is the box-side length. D b is then estimated by 
plotting the number of boxes N(d) against the box-side length d. This method is similar to 
the areography technique in which boxes are fixed ‘sub-regions” defined by geographical 
coordinates [17, 18] instead of grids of changing sizes. 

The information dimension (D e ) method is similar to the box counting method 
except that more weight is given to boxes with more points. As boxes containing a large 
number of points count more than boxes with fewer points, the equation is: 

H(d)* -D e log(d) (4) 

where H(d) is the entropy, which commonly used in information theory. This value 
includes both the number of boxes and their evenness or occurrence based on the number 
of points they contain as per the equation: 

H = Y,pMp,) ( 5 ) 

where p, is estimated as n/N, n, is the number of occurrence or evenness of the box i, and 
N is the total number of points across all the boxes. 

In the case of fragmentation method, the fractal dimension (Dj) is defined as the 
exponent D f where N(a) is the number of areas or patches of size a. The distribution of 
the areas according to a power-law is: 

N{a)=a Df (6) 

The different measurements of the fractal dimensions of all the above equations were 
carried out using Benoit Fractal Analysis Software version 1.3 (TruSoft International, 
Florida, USA) [16]. 

2.4. Size and shape of the taxons’ patterns of distribution 

To define the size and the shape of the area, we consider that the centroid of the 
probability surface and the variances contain information on the extent (size) of the 
distribution, and that the correlation between latitude and longitude provides information 
on the shape and orientation [4]. Both the shape and the size parameters are expressed in 
terms of second-order central moments as: 

c _ (Miq-M oi) 1 +*M\\ 

(Moo) 
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Figure 1. a) Dot distribution of 1376 locations sampled through various explorations including genetic resources 
records, b) Probability surface (“geographical range”) for the wild cowpea varieties based on dot distribution 
data and climate data. 



Figure 2. Relationship between the different fractal dimensions and the logarithm of the zero-order moment 
which is proportional to the area. Only two regression lines fit the data significantly with d.f. = 7 ,F = 264, and 
P= 0.000 for D t , and d.f=7, F= 33, and P =■ 0.001 for D e . 
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where e and Q are respectively the eccentricity and the orientation of the surface 
distributions [19] and pi„p is defined in the Appendix. The equations sequences on 
moments are also detailed in the Appendix. 

3 Results 

Once the probability surfaces have been generated for the different distributions, the 
fractals and moments were calculated to derive the different descriptors in Table 2. 

The fractal dimension values in Table 2 show that the geographical patterns of the 
distributions of different taxa vary significantly. The high value of D b (1.719) for taxon 1 
indicates that the geographical range of this taxon is more space-filling than all of the 
other taxa. The correlations are positive between the zero-order moments m m , which 
represent the area, and both D b and D e (Table 3). The two regressions of the logarithm of 
moo as an independent variable and both Db and D e as dependent variables are also 
significant with a high squared multiple R: 0.974 (Figure 2) for D b . The correlation is 
also positive and significant between the shape measured by the eccentricity (s) and 
fractal dimension D b (Table 3). 


Table 2. Fractal dimensions and shape parameters or descriptors for the different taxa. 


Taxon* 

Dt 

D„ 

Df 

Area (m m ) 

Orientation)#) 

Eccentricity) f) 

Taxon 1 

1.719 

1.78 

1.773 

22949 

-0.668 

20.143 

Taxon 3 

1.332 

1.577 

2.039 

2761 

-0.339 

16.221 

Taxon 7 

1.437 

1.479 

1.844 

5005 

-0.451 

20.215 

Taxon 8 

1.276 

1.501 

1.801 

2463 

-0.500 

16.689 

Taxon 9 

1.257 

1.365 

1.67 

1565 

-0.231 

18.064 

Taxon 10 

1.073 

1.255 

1.756 

740 

-0.410 

15.023 

Taxon 11 

1.127 

1.222 

2.006 

1244 

0.740 

15.886 

Taxon 12 

1.462 

1.576 

2.16 

6188 

0.560 

16.337 


* Taxa 2, 4, 5 and 6 have only a few records and their distribution maps were not produced. 


Table 3. Correlation between the different estimates for the nine taxa derived from their separate 
distributions. 



D,, 

D e 

Df 

Area (m m ) 

e 


Fractal (Db) 

1.000 






Fractal (D e ) 

0.930* 

1.000 





Fractal (D fi 

0.071 

0.108 

1.000 




Area (log(moo)) 

0.987* 

0.909* 

0.156 

1.000 



Orientation) 6) 

-0.304 

-0.414 

0.693 

-0.234 

1.000 


Eccentricity)^) 

0.759* 

0.567 

-0.369 

0.717* 

-0.471 

1.000 


* Statistically significant correlations 


The information fractal dimension D e concords with the box counting dimension D b , 
but the fragmentation dimension D f differs from both, in that it shows a greater effect 
from diffusion and fragmentation of the distributions. When Dj « 2 the distributions are 
diffuse and highly fragmented (Figure 3 and Table 3). While both taxon 1 and taxon 12 
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have high D b values they differ significantly in their D f values. The distribution of taxon 
1 is more continuous when compared to that of taxon 12 , and the reverse is true for taxa 
3 and 11. While both taxon 11 and taxon 3 show the same degree of fragmentation, their 
space-filling values are different with taxon 3 having relatively more space-filling than 
taxon 11 . 

To quantify the amount of information obtained on the distribution patterns using 
different fractal parameters we have used Shannon's mathematical definition of 
information, where a robust measure (e.g., D) should reveal values beyond what is 
expected [ 20 , 21 ] as per the equation: 


l{d) = M 0 ) lo g[p(£>)] 


(9) 


where p, is estimated as n/N, n , is the number of categories, and N is the total number of 
individuals recorded in all the categories or classes defined using the mean and the 
variance of the distribution p(D). 

The total variation for each parameter was divided into four categories (C 1 ...C 4 ; 
where p - SD < Q < p + SD) defined using the mean and the variance. The 1(d) was 
measured for each variable separately. The results in Table 4 show that the box counting 
method has the highest 1(d) value (0.574), while the fragmentation method has the lowest 
(0.423). Based on 1(d) value, the box counting method is more robust in detecting more 
variability than the information method. 


Table 4. The amount of information based on I (index) 


Fractal dimension Mean 

~D h 1.335 

D e 1.473 

D f 1.866 


SD 

0.192 

0.173 

0.164 


1(d) 

0.574 

0.527 

0.423 


4 Discussion 

The present results indicate that fractal geometry can be used to describe plant species’ 
distribution patterns. Fractal dimensions using box counting has been found more 
discriminating than the other two fractal dimensions based on Shannon index (/) value. 
Previous work carried out by Maurer [4] has also shown that the box counting method 
can be useful in the description of species’ distribution patterns. Although the 
fragmentation dimension is not as robust, it remains an important measure of the degree 
of diffusion and fragmentation of the distributions. 

In total these parameters can assist in the quantitative estimation of the geographical 
pattern of species distribution [4, 22, 23]. Their potential has been recognized in the 
study of species’ patterns of distribution and also in the design and ranking of in situ 
conservation priorities, reserves, and hot spots [4, 8 , 10, 22, 24]. Other advantages of 
fractal geometry are their closeness to model reality, such as in mapping semi-continuous 
distribution patterns of variation, in contrast to methods that produce binary maps 




295 


composed of cells showing only the presence or absence of a species [25], Fractal 
algorithms have been used to produce patchy landscapes that remarkably resemble real 
landscape patterns [23], The data used in this study will be combined with other data and 
other predictive methods based on the concept that methods developed in one discipline 
may by analogy be used to advance other disciplines [26, 27], The overall aim of the 
work is to locate where the diversity for the species under study is the highest to help in 
planning further targeted explorations and in the design of in situ conservation sites. In 
the case of wild cowpea this region is located in the south-eastern part of the African 
continent. 


Appendix 


The centroid of the distribution (probability surface) can be expressed in terms of 
moments as follows: 


m io 

^00 


where (x c , y c ) are the coordinates of the centroid. The moments in turn are calculated 
from the equation below: 


-I 2>Vz, 


where the order of the moment is a+j3 , x and y are the geographic coordinates, and z xy 
represents the diversity (number of entities) or probability found in the z' ,h vector [z' th 
square] . 

The estimates of the transformed latitudinal and longitudinal variances and 
covariances between them are: 



where p a p are the central moments derived from the zero-, first- and second-order 
moments as per the equation: 


Mep = ^Y^ x - x c) a ^-ycY z ^y ■ 
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One-dimensional binary automata are allowed to interact with each other using a 2x2 
binary payoff matrix. In this way, chaotic evolution can be controlled or chaos can be 
induced (anticontrol). For each matrix, a hierarchy of the automata can be established as 
follows: an automaton with a higher rank controls (or anticontrols) an automaton with 
a lower rank. For some matrices and some rule number intervals, the ranking depends 
monotonically on the rule number. 


1. Introduction 

Nearly one thousand publications are found nowadays in the ’Web of Science’ on the 
subject of chaos control, frequently in connection with cardiological or engineering 
applications (for reviewing books, see 1,a ). In particular, chaos control has been 
studied in spatiotemporal systems described by cellular automata (CA) (see e.g. 3 
and references therein). In addition, one finds works on ’anticontrol’, namely on 
the induction of chaos in a non-chaotic system. The latter is especially important 
in the treatment of epileptic seizures, the goal of anticontrol being to desynchronize 
components of the brain (see e.g. 4 ). 
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In the present work we study interactions between CA using 2x2 matrices M. We 
will show that the possibility of chaos control or anticontrol of one CA by another 
one leads (for particular matrices M) to well-defined hierarchies of the CA. 

The subject of CA hierarchization, parametrization and classification has gone 
through an intense history in the last twenty years. It starts with the work of 
Wolfram 5 , who studied CAs that operate by iterating a one-dimensional string of 
cells. Each cell can be in one out of k states (for example: state 0 or state 1, for 
k = 2). The state in a given cell in the next time step is determined (according to 
a given rule) by the state in that cell and the states of r neighbours at each side 
of the cell. According to the temporal evolution of the iteration process, Wolfram 
defines four CA classes: 

i) class 1 if evolution leads to homogeneity; 

ii) class 2 if evolution leads to periodicity; 

iii) class 3 if evolution leads to a chaotic pattern; and 

iv) class 4 if evolution leads to complex localized structures, sometimes long-lived. 

Langton 6 parametrized the CA defined by Wolfram. For this, he defined a pa¬ 
rameter A equal to the percentage of outputs of the rule which do not lead to zero. 
It was found 6 that the values of A roughly correlate with the classes defined by 
Wolfram. Slightly differing versions of these classes were put into a more formal 
language in the work of Culik and Yu 7 , as well as in Ishii’s probabilistic measure 
theoretic approach 8 . 

A number of other classifications (alternatives to those mentioned above), some of 
them involving hierarchization and parametrization, have been reported. Jen 9,10 
classified CA by considering the finite sequences which have no pre-image under a 
given rule. Voorhees and Bradshaw refined that classification by determining some 
properties of theses sequences 11 . Gutowitz 12 ordered CA as follows: given ap¬ 
proximations of the CA by n-step Markov processes, a CA class is the set of CA 
corresponding to each approximation. Binder 13 then classified the CA according 
to attractor globality, i.e. according to the property of all initial conditions evolving 
to the same attractor. This was followed by the work of Kohring 14 , who ordered 
CA according to the number of stable points for a given rule. Markus et al. 15 
quantified CA by counting the number of periods larger than 1 resulting from all 
possible initial conditions for small numbers of cells. Later, Baldwin and Shelah 16 
classified CA according to their computational properties (capability to simulate a 
Turing machine). Then, Dubacq et al. presented an approach based on algorithmic 
(Kolmogorov) complexity, measuring the ” randomness” of evolution through the 
information content of the local rules 17 . These authors had been inspired by Braga 
et al. 18 , who had investigated how the local rules influence the global behaviour of 
the CA, but using a topological instead of an algorithmic approach. Recently, Durr 
et al. 19 provided yet another approach using Communication Complexity Theory: 
they partitioned the CA cells into two subsets and determined the information ex- 
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change for the computation of the CA states that are required by two ’actors’, each 
of them knowing only one of these subsets. 

Notwithstanding the large amount of works on CA classification and parametriza- 
tion, we continued to work on these lines. We did so with practical goals in mind, 
namely control and anticontrol, which had not been considered before in this con¬ 
text. In order to attain these goals, we let the rules interact with each other. Previ¬ 
ously, interaction between rules had ben investigated by Brown 20 , who introduced 
a ’meta rule’ that determines the (evolving) rule operating at each cell. Another 
way of interaction was reported by de Silva et al. 21 , who applied stochastically one 
rule or a second one according to a given probability. CA with rules changing in 
given subsets of the cells are given by Mori et al. 22 . In the present work, we shall 
let rules interact via a 2x2 matrix, which is analogous to a payoff matrix in game 
theory (see e.g. 23 and references therein). We will search for matrices that allow 
to establish a hierarchy of the CA, considering their abilty to control or anticontrol 
each other. 


2. Algorithm 

We consider one-dimensional CA, as introduced by Wolfram 5 with k =2 (two states: 
0 or 1) and two neighbours (r=2), i.e. with five cells in each neighbourhood. We 
consider totalistic rules, meaning that the output F on any site depends solely on 
the sum s of states within the neighbourhood. We consider only rules that are 
called ’’legal” by Wolfram, i.e those for which the output is 0 for s = 0. The code 
C is given by 

5 

c = J2 f (s) r ( 1 ) 

s=0 

C= 62 and C=64 are not considered, as they trivially lead only to l’s. We are thus 
left with the 30 rules with C = 2n, 0 < n < 30, which were graphically displayed 
by Wolfram in 5 . Wolfram classifies these rules as follows: 

i) class 1 (homogeneous): C— 4, 16, 32, 36, 48, 54 and 60 ; 

ii) class 2 (periodical): C=8, 24, 40, 56 and 58; 

iii) class 3 (chaotic): C= 2, 6, 10, 12, 14, 18, 22, 26, 28, 30, 34, 38, 42, 44, 46 
and 50; 

iv) class 4: C=20 and 52. 

In our algorithm we evaluate the outputs / n (t) and g n (t) of two CA at a cell n 
(n = 1,2,3,...., N; cyclical border conditions) at times t — 0, ...,T. Considering 
a 2x2 matrix M = (ay) , where ay = 0 or 1, we let the CA interact by writing 
fn(t + 1) = au and g n (t + 1) = aji, where I = f n (t) and J = g n (t). 

When regarding anticontrol, we say that a rule A has a higher rank (in the CA 
hierarchy) than a rule B, if the interaction of A and B causes B to become chaotic 



or to remain chaotic (class 3). When regarding chaos control, we say that A 
higher rank than B, if the interaction of A and B causes B to become non-cl 
(classes 1,2 or 4 or travelling waves) or to remain non-chaotic. Note that we 
defined here class 4 as a controlled state, considering that class 4 automata < 
to homogeneity or to periodicity for finite T. We assign A and B the same r 
both A and B are controlled or anticontrolled. 
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Symmetrical matrices M are not interesting in this work because they drive A and 
B into the same CA. The matrix (q }) is not interesting either, since it leaves both A 
and B unchanged. M = (j°) also changes nothing, except for 0’s to become l’s, and 
viceversa. Thus, there are only four matrices left to investigate: (j°), (qJ), (J*) 
and (Jj). 

We consider only ranks that are transitive within a given set of rules, i.e. if A 
(anti)controls B and B (anti)controls C, then A (anti)controls C. 

3. Results and discussion 

Examples of control and anticontrol with different matrices M are shown in Figs. 1 
and 2. In these figures, the evolution of the CA that exerts control or anticontrol, 
owing to its higher rank, is shown on the left, while the controlled or anticontrolled 
evolution (lower rank) is shown on the right. 

We are unable to recognize any self-consistent ranking when using M — (° °). The 
only facts that can be stated in this case are: rule 32 controls all other rules; rule 
30 anticontrols all other rules, except 32. 

The results are more satisfactory when using M = (°g) . In fact, one recognizes 
a ranking among the chaotic rules, when regarding control. This is illustrated in 
Fig. 3a. (Note that on Figs. 3a, 3b and 3c the numerical values for the ranking are 
arbitrary, with a higher rank denoted by a higher vertical position). In the case of 
Fig. 3a, rule 30 controls all others, while rule 12 is controlled by all others. The 
ranking is equal in the pairs (14,46), (10,42), (34,44) and (18,50). The result is 
less satisfactory for anticontrol: the only non-chaotic CA that can (in a few cases) 
be anticontrolled are those with C = 54 or 58. 

The results for M = (*}) are shown in Fig. 3b. Here, two sets of rules are found 
for control (2 through 12, and 12 through 50), each set being self-consistent within 
itself, while there is no well-defined scheme when the interactions occur between 
rules of the different sets. (Note that the sets are distinguished in the figure by 
connecting its elements with dashed lines). For anticontrol we found only one set. 
Note that in Fig. 3b, both for control and anticontrol, one observes something that 
is not seen in Fig. 3a: monotic dependences (decreasing or increasing) of the ranks 
with the rule number C. 

For M = (J J) (Fig. 3c), one obtains one set for control, the ranks of which increase 
with C, and one set for anticontrol, the ranks decreasing with C. The only excep¬ 
tion that disrupts monotonicity is rule 14. 

A rough explanation of the monotonicity for control with M = (J °) is the following. 
A CA with relatively low C generates mainly 0’s, which are all turned into l’s by 
M. This swamping with l’s prevents the expansion of chaotic patterns. In the case 
of anticontrol the argument is opposite: a CA with larger C generates mainly l’s, 
which are turned into 0’s only partially by the action of a CA with a lower C; thus, 
chaos due to mixing of 0’s and l’s appears in the CA with larger C. We are not 
able to give any explanation going beyond these partial arguments. 
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Figure 2. Examples of anticontrol, (a) Rule 16 (homogeneous) becomes chaotic (right picture) 
by interacting via M = (JJ) with rule 20 (class 4), which itself becomes chaotic (left picture), 
(b) Rule 36 (homogeneous) becomes chaotic (right picture) by interacting via M = (\°) with rule 
34 (chaotic), which itself stays chaotic (left picture), (c) Rule 36 (homogeneous) becomes chaotic 
(right picture) by interacting via M = (}J) with rule 24 (periodical), which itself remains homo¬ 
geneous (left picture), (d) Rule 16 (homogeneous) becomes chaotic (right picture) by interacting 
via M = (J j) with rule 24 (periodical), which itself also becomes chaotic (left picture). 


4. Conclusion 

Hierarchical and parametric classifications of CA have been presented before (see 
references in the Introduction). The novelty of the present work is that such a clas¬ 
sification is performed using control and anticontrol, which are useful operations in 
many areas (see e.g. 1|2 ). 

Mathematical proofs, including the monotonicity of the ranks with respect to C, 
could be a valuable future goal; however such proofs are probably difficult owing to 




303 



(b) 


20 24 28 32 36 40 


22 26 30 34 38 42 46 50 54 58 


_.®" CONTROL 


12 16 20 24 


Figure 3. Ranks (ordinates; arbitrary units) of cellular automata rules (codes C in the abscissas) 
for different interaction matrices M (given on the right of each picture). The following holds within 
each set of points connected by dashed lines: a rule with a lower rank, i.e. lower abscissa, behaves 
chaotically (in the cases of anticontrol; crosses) or behaves non-chaotically (in the cases of control; 
crosses with circles) if it interacts with a rule having a higher rank. 


the exceptions (e.g non-monotonicity due to rule 14 in Fig. 3c, as well as several 
rules which do not fit into the schemes depicted in Fig. 3). 

The present work may be considered as a first step in future endeavours concern¬ 
ing automata with physical applications 24 > 25 . Concretely, this could mean that a 
parameter is found in such automata, which permits to establish a hierarchy (anal¬ 
ogously to our work) for achieving control or anticontrol. 
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FRACTAL ANALYSIS OF THE IMAGES USING WAVELET 
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This article describes a new method of determining fractal dimension and fractal measure using 
integral (e.g. wavelet - Haar) transformations. The main advantage of the new method is the ability 
to analyse both, black & white and grey scale (or colour) images. The fractal dimension (box 
counting fractal dimension) evaluated using the Haar transformation offers in difference to the 
classic box counting method much wider range of usability. It can be also used to determine the 
fractal parameters of surfaces or volume of three-dimensional structures e.g. distribution of the mass 
or electrical charge in the surface or space. The theory of the fractal structures in ^-dimensional 
Euclidean space is described more closely in our previous work. 


1 Introduction 

Fractal analysis has become one of the fundamental methods of the image analysis. 
Fractal dimension D and fractal measure K [1] are the two characteristic values, which 
can be determined by fractal analysis. Fractal measure characterizes the properties of 
surfaces and edges of image structure, whereas the fractal dimension shows the trends of 
surfaces and edges changes in relation to the details of structures themselves. 

Fractal dimension value lies in the range D e (0, E ), where E stands for Euclidean 
space dimension (E = 2). The limits of the range of the fractal dimension values can be 
also described as: 

- for D -> 0 the change of the structure as a function of the size of its measure is 
maximum (this is characteristic for image structures where analysed structure forms 
just small part of the complete image, e.g. some colour has very minor representation 
in the image or the length of the edge between different colours is very short), 

- for D -» 2 the change of the structure doesn’t depend on the change of measure (the 
analysed structure fills image almost completely, e.g. one colour has majority in the 
image or the edge fills whole image - Peano curve). 

Fractal measure lies in the range K e (0, A" max ), where K mm is total count of pixels 
within the image. Using the fractal measure we are able to determine how much of the 
image is covered by the analysed structure. For example fractal measure of Peano curve 
is equal to the total count of the pixels within the image (or we can say that the coverage 
by the edge is 100%, K/K mm = 1 respectively). The fractal dimension of the edge between 
black and white within the image is then ZJ BW = 2. 

The method most often used to determine the fractal parameters of the image is 
called box counting method. This method allows analysing of black & white pictures 
created by changing of threshold value of colourful image structure by specified criteria 
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(e.g. on RGB, HSV, HSB space) - the thresholding. The results of fractal analysis (using 
the box counting method) are box counting fractal dimension and box counting fractal 
measure. 

This article describes a new method of determining fractal dimension and fractal 
measure using integral (wavelet - Haar) transformation. The main advantage of the new 
method is the ability to analyse grey scale (or colour) images without lengthy 
thresholding and calculating the box counting fractal dimension D and fractal measure K 
for each thresholded image in the set. 

More detailed results of the analysis using this new method can be found on our web 
pages http://www.fch.vutbr.cz/lectures/imagesci . The interpretation of the results 
obtained from the black & white image analysis (using the new method) remains the 
same as from the box counting method of black & white pictures. The main disadvantage 
of the new method may be seen in smaller set of data used for regression analysis as in 
box counting method. There can be obtained only 10 independent values per image with 
1024 x 1024 pixels matrix that can be used to determine the fractal dimension D and 
fractal measure K. Such disadvantage can be turned into an advantage as removing 
redundant use of pixels minimizes the error introduced by reusing the values of wrongly 
determined values of pixels. 

2 Box counting method 

Analysis of black & white images is usually performed by box counting method [2], 
Figure 1 shows how is the method used. A net of different size (lxl,2x2, 3x3,4x4, 
etc. pixels) is placed on the analysed image and the total count of black boxes Ns, white 
boxes A w and black&white AW boxes is determined. 



Figure 1 Determination of the fractal measure and ftactal dimension using the box counting method. 


The function of the count of pixels on the net size e = 1/n, where e is the size of 
pixels and n is the scale, is used to determine three different types of fractal dimension: 
black area, white area and their edge (Dbbw, Wbw, D bw )- To calculate the dimension 
Dbbw and Avbw, the count of black and black & white (BW) A BBW = N B + N BW or 
white and black & white (BW) /V WBW = N w + N BW boxes is utilised. The variation of 
fractal dimension with the count of boxes can be written 
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n( £ )=Ke d N(n)=Kn D (1) 

respectively, where K is the fractal measure and D is the fractal dimension (without their 
indexes). From these terms the fractal dimension is given by the slope of function (1) 
din iv(g) din N(n) 

dins dln« ■ (2) 


The area filled by the examined set (points) can be expressed as 


n 

and the length of lines in figure as 


( 3 ) 

( 4 ) 


respectively. 

The Figure 2 shows the dependency obtained from the model image of a tree for 
black & white squares. The image shows that the function is almost linear (structure of 
the image is fractal). There is clearly a visible error for small sizes of the boxes 
(introduced by the interpolation of values) and also error for the very big sizes of the 
boxes (introduced by saturation of the number of boxes). 



Figure 2. Determination of the fractal measure and fractal dimension using the box counting (see Figure 1) and 
for wavelet method (see Figure 3 - Figure 5). 

Acquired fractal measures A^bw, Xwbw, -Kbw can be used for determination of the 
black - Sb (white - S w respectively) areas of threshold figure 

s £bbw-*bw s ^wbw-^bw 

B a bbw + k wbw - a bw - w a: bbw + /f WBW - a: bw ( 5 ) 

and the length of divided lines L of threshold figure 
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The results are taken in relative units (multiplied by 100 in percent). Results in 
pixels can be taken after multiplying this number by area size of the figure (K msx ). 

3 Wavelet method 

The description of the box counting method shows that it is variation of integral methods. 
Using that knowledge the authors tried to find the best integral transformation that can be 
used to evaluate the fractal parameters of image structures. The driving force of our 
effort was to simplify the algorithm for determination of the fractal dimension and to 
extend the range of possible interpretation of the results. It was found that already very 
simple wavelet transformation - Haar transformation [3] gives us the identical results of 
values of fractal parameters (for threshold figure) as the box counting method. 

Haar transformation (HT) is linear orthogonal transformation with signum function 
(rectangle function) base. The HT transforms real image fljn, n) into discreet spectrum 
represented by real function F(k, 1) 

= (7) 
where h nJi and h mJ are the coefficients of so called Haar matrix H N 

1 1 1 

1 1 -1 - 

1-10 1 
0 0 1 - 

Haar matrix H„ is the order of 2” (2” dimensional matrix). 



Figure 3. Spectra of image structure determined by Haar transformation of image from Figure 1 (wavelet 
method) 

The method requires (like the Fast Fourier Transformation) a square matrix of data 
given by square of two. Figure 3 show the resulting spectra and images of the tree 
(.Figure 7) of size 1024 x 1024 pixels. The spectra are calculated using the matrix of 
Haar transformation (transformation base) of size (matrix and image) 1024 x 1024 
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pixels. Figure 3 shows top left comer cut from the complete matrix (2 x 2, 4 x 4, 8 x 8 
pixels). The top left item of the matrix stores information about amount of black pixels 
within the image. The information about count of black pixels in each quarter of the 
image can be then determined from the matrix obtained by the reverse Haar 
transformation (such matrix is then half of the size of the original matrix), see Figure 4. 

The Figure 5 shows information about count of black pixels in the quarter of the 
matrix. Shades of grey on Figure 4 are equivalent to the count of black & white (BW) 
pixels in the quarter. Fractal dimensions of black, white and black & white can be 
determined as it was possible when using box counting method (D BHW , Avbw, T>bw). The 
parameters obtained by our method are identical to parameters determined by the box 
counting method for matrixes of 2" x 2" (1 x 1,2 x 2,4 x 4, 8 x 8, etc.) pixels. 



64x64 32x32 16x16 

Figure 5. Determination of the fractal measure and fractal dimension using wavelet method (tresholded squares) 


The function of count of black & white squares is displayed in Figure 2 (these 
determine the characteristic of the interface between black and white areas in the image). 
The fractal dimension determined by the box counting method was D B w = 1.1053. The 
graph displayed shows that the function is not linear. The exact derivative of the function 
is shown in Figure 2 right. Error in the big squares area (on the right side of the graph) is 
caused by error of applying grid on the image (error is approximately same for both 
methods). Error in the small squares area (left side of the graph) is caused by wrong 
interpolation of the data. Inflection point of the graph curve is exactly at the point equal 
to the value of the fractal dimension of the structure. 

The acquired fractal measures K mvj , K wBW , ^bw can be used for determination of 
black and white areas of figure and the dividing lines lengths using the same equations as 
for box counting method, see Eqs. (5) and (6). 
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4 Algorithm of fractal parameters calculation using the Haar transformation 

The method of fractal parameters calculation described in the previous chapter is 
relatively time-consuming. It requires performing the direct Haar transformation of 
analysed picture (with size 2" x 2" pixels) and (n-1) reverse Haar transformations of 
spectrums, which were previously filtered by low-pass filtering (n-1 ) x (n-1 ), (n-2) x 
(n-2),... pixels. The fractal parameters are then calculated using standard technique (like 
box-counting method) from the sequence of the obtained pictures with flattened details. 

It was found by detail problem analysis that the algorithm above can be simplified 
by simple adding of four adjacent pixels (which have values 0 and 1 in the original 
thresholded picture). After the first step we obtain picture of size 2” -1 x 2 ” _1 pixels with 
values from 0 to 4, after the second step the picture will have its size 2"~ 2 x 2 ” -2 pixels 
with values from 0 to 16, etc. The N s of the picture is then the number of pixels with 
value 0, the AT W is number of pixels with maximal value (i.e. 1, 4, 16, ... , 2 2 ”) and the 
AW is the number of the rest of pixels. The log N = f(log n) dependency allows to 
determine the fractal dimension and fractal measure of the tresholded picture using the 
standard techniques. The analysis of a black box gives fractal dimension D w = 0 (number 
of white pixels is always zero) whereas the analysis of a box containing only white pixels 
results in Dy = 2. 

5 Analysis of three-dimensional structures 

In the case of analysing a grey scale picture, it is supposable, that the shade represents a 
profile of a three-dimensional structure (see e.g. Figure 6). In this case the particular 
pixels have values from 0 (black) to 255 (white). Adding of values of foursome pixels 
results in picture of 2"~ s x 2 ”~ l pixels size with values from 0 to 1020. After the second 
iteration a 2” -2 x2"” 2 pixels sized picture with values from 0 to 2040 is obtained, etc. 



2D projection 3D projection 

Figure 6. Determination of the fractal measure and fractal dimension of 3D structure (fractal dimension of 


surface) using wavelet method 


The N b of each individual picture is then the number of pixels with value 0, the ,V W 
is the number of pixels with maximal value (i.e. 1020,4080,..., 255 • 2 2 ") and the AW is 
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the number of the remaining of pixels. The log N = f(log ri) dependency allows to 
determine the fractal dimension and fractal measure of the tresholded picture using the 
standard techniques. The analysis of a black box gives fractal dimension Z3 W = 0 (number 
of white pixels is always zero) whereas the analysis of a box containing only white pixels 
results in£>w= 3. 

The volume filled by the examined set (points) can be expressed as 

H") =?&=K-n°-\ (9) 


The following equations determines the areas under (V B ) and above (F w ) of the 3D 
object surface 


( 10 ) 


and area size S 


S = 


K BBW 


+ ^WBW ^BW 


( 11 ) 


in relative units (in percent respectively). Volumes and areas in volume pixels (voxels) 
can be obtained by multiplying the results by the maximal volume. It depends on the area 
size of figure and its colour depth (e.g. for eight bit depth is given by multiplying by the 
number 2 8 -1 = 255). Coefficient which determines how many times is the fractal 
surface area higher then the horizontal surface area (size of figure) can be also calculated. 



Figure 7. Determination of the fractal measure and fractal dimension of 3D structure (fractal dimension of 
surface) using wavelet method 


Fractal dimension of surface of a fractal structure in Figure 6 is Z) B \y = 2.263. Fractal 
dimension of the structure volume was found to be £> BBW = 2.877 and fractal dimension 
of the surrounding volume is Avbw = 2.900. Volumes of the object and surroundings 
have the fractal dimension near the value of the Euclidean dimension of volume E = 3. 
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This implies that the object has nearly the Euclidean shape. Fractal dimension of the 
surface is significantly bigger than the Euclidean dimension of plane E = 2 and has 
therefore evidently fractal nature. The fractal measure of the interface determines the size 
of the fractal structure surface (in pixels) and is K^/IK m!0i = 362.79 % of the image’s 
planar surface, where AT max = (512 x 512) pixels. Fractal measure of the structure volume 
is ^BBw/^max = 40.97 % and its surroundings K WRW /K mllx = 59.03 %, where 
K max = (512 x 512 x 255) voxels (volume pixels). The fractal measure of the interface 
tells us therefore that the surface of the fractal structure is more than three times larger 
than the surface of plane. 

6 Conclusion 

It is worth mentioning that the fractal dimension of the deterministic fractal structures 
(e.g. Sierpinsky carpet) is immutable in the whole range of sizes of the net applied on the 
image using box counting method (or level of filter using wavelet - Haar - 
transformation) and is the same as the theoretical fractal dimension value. Similar fractal 
dimension values were also obtained using other types of integral, e.g. the Fourier 
transformations. In this case the values of fractal parameters are influenced by broader 
vicinity (step function is replaced by harmonic function). 

The fractal dimension evaluated using the Haar transformation offers in contrast to 
the classic box counting method a much wider range of usability. The method can also be 
used to determine the fractal dimension of colour structures (e.g. greyscale or full colour 
images). This also allows determining the fractal dimensions of surfaces specified by 
shades of grey or colour components. This can be also used to determine the fractal 
parameters of surfaces or three-dimensional structures like distribution of the mass in the 
space or electrical potential in space. The theory of the fractal structures in E- 
dimensional Euclidean space is described more closely e.g. in [4,5], 

Software for fractal analysis of the images is provided free on the Internet 
http://www.fch. vutbr.cz/lectures/imagesci . 
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Two years of lightning data, measured during 2002 and 2003 in two areas of Italy, Lombardia 
(northern Italy) and Campania (southern Italy), have been investigated in order to reveal clustering 
properties in their time dynamics. The Allan Factor analysis has been performed. Our findings point 
out to the existence of time-clustering in the sequence of lightning time-occurrences, characterized 
by the presence of two scaling regions, which reveal intra-cluster (inside individual thunderstorms) 
and inter-cluster (among successive thunderstorms) time-clustering properties of lightning data. A 
crossover timescale is identified, which could be connected with the mean duration of a 
thunderstorm. 


1 Introduction 

Lightning, defined as a high and transitory electric current, are usually generated by 
electrostatic charge separation occurring in thunderstorm clouds [1]. The most accepted 
explanation for this process is the friction and collision among ice and water particles 
traveling in convective drafts in the cloud. Charged particles tend to migrate to far regions 
of the cloud, typically the top and bottom, to reach a configuration of a dipole or multi¬ 
pole; earth polarizes opposite to the bottom cloud charge becoming another pole. The 
electric field intensity between dipoles can reach the breakdown level and originate a 
lightning discharge [2]. 

The total discharge is called a “flash” and is a complex process involving one or 
more subsequent current flows; each of these currents is called a “stroke”. A flash lasts 
for about half a second, while each stroke takes around one millisecond [3], 

A flash can thus happen between two clouds or into the same cloud or from cloud to 
ground. This last category, even if the less numerous, is by far the more known and 
studied [4], Cloud-to-ground flashes could be subdivided in positive and negative from 
the current polarity or in upward and downward from the direction of motion. Positive 
cloud-to-ground discharges are rare, around 10% of the cloud-to-ground total; they can 
transfer to ground a considerable quantity of charge, compared to the negative lightning, 
and can have higher current intensity than negative ones. Usually positive flashes are 
much more common in winter thunderstorms [5]. 

Thunderstorms vary from region to region on the Earth, due to different latitude, 
meteorological conditions, orography [6], A mean of 100 s-1 lightning strikes the earth, 
of which much more fall over land than on the oceans; tropical thunderstorms present a 
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higher number of flashes [7]. In our case the region under study is in the temperate area, 
in southern Italy. In Italy the thunderstorms are of three main kinds: 

1. large fronts: these are formed by collision between incoming cold air mass and pre¬ 
existent hot air mass. These thunderstorms are joined to atmospheric disturbance and 
they are dynamic thunderstorms. In Italy large front thunderstorms come generally 
from North-West; 

2. local convective cells: these are produced by convective cells that develop usually 
during afternoon on mountains and during late-aftemoon or evening on plain, when 
the unstable weather conditions are more favorable. This thunderstorm kind is typical 
in summer season; 

3. orographyc thunderstorms: they are generated by raising air mass due to the presence 
of a slope. They develop typically in Alpine and Appenninic regions. 
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Figure 1. Time distribution of lightning in Campania (southern Italy) and Lombardia (northern Italy) in 2002 
and 2003. 
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Figure 1 (cont.). 
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Figure 1 (cont.). 

2 Lightning Data 

In this study we analyze the temporal properties of the cloud-to-ground lightning activity. 
The data have been provided by the lightning location systems (LLS) of Sistema Italiano 
Rilevamento Fulmini (SIRF) [8], which is a network detecting cloud-to-ground lightning 
activity over all of Italy, composed by 16 IMPACT (Improved Accuracy from Combined 
Technology) sensors [9] located throughout Italian territory. The mean accuracy of the 
system is 500 m for both co-ordinates of the point of impacts. SIRF allows the detection 
of single strokes with peak current value greater than about 2.5 kA. The nominal flash 
detection efficiency is roughly 90% over all the area [8]. The SIRF system provides a set 
of information for each cloud-to-ground lightning: date, time of occurrence, lightning 
impact coordinates, peak current, stroke number, polarity, statistic parameters. 

A sequence of 34,502 (during 2002) and 29,200 (during 2003) lightning flashes was 
recorded in Campania (southern Italy), and 55,496 (during 2002) 48,540 (during 2003) 
occurred in Lombardia (northern Italy). Figure 1 shows the time distribution of the 
lightning. The association of lightning into clusters (time-clusterization) is rather clear by 
visual inspection from Figure 1. 
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3 Allan Factor Analysis 

The aim of the present study is the identification and quantification of the clustering in 
lightning sequences. The power spectral density (PSD) S(f), obtained by means of a 
Fourier Transform (FT) of the series, was the standard technique used to investigate the 
temporal properties of a time series. The PSD gives information on how the power of the 
series is concentrated at various frequency bands [11]. This information allows 
identifying periodic, multi-periodic or non-periodic frequency patterns. Usually the 
logarithmic power spectrum plot, that is the power spectrum plotted in log-log scales, is 
used to analyze broadband behaviour. The power-law dependence (linear on a log-log 
plot) of the PSD, given by S(f)~ f“, is a hallmark of the presence of time-scaling in the 
data. The properties of the series can be further classified in terms of the numerical value 
of the spectral exponent a=0 or a^O feature white noise or pink noise time series, thus 
indicating the absence or presence of time correlations respectively [12]. 

A lightning sequence is a temporal point process, that is a set of events occurring at 
random locations in time [13], and the simple application of the FT is not possible. We 
can represent the lightning data by a finite sum of Dirac’s delta functions centered on the 
occurrence times f, with amplitude Aj proportional to the current: 

y(t) = f j A i S{t-t i ) 

i=1 , ( 1 ) 
where N represents the number of events recorded. 

Then dividing the time axis into equally spaced contiguous counting windows of 
duration x, which is called timescale, we produce a sequence of counts {N k (T)}, with 
N k (x) denoting the number of flashes in the k-th window [14]: 

N t (r)= )Y J S(t-t j )dt 

. ( 2 ) 

where t is the integration variable. We can define the following quantity, the Allan Factor 
(AF), 


. <(AWr)-W t (r)) 2 : 

AF(r) = -2<Af,(r)> 


which is related to the variability of successive counts [15,16], where <„> indicates the 
expectation value. The AF has been largely used to investigate the time dynamics of 
earthquakes [17]. 
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over a large range of timescales x, with the exponent a, which quantifies the strength of 
time-clusterization; Xj is the fractal onset time and marks the lower limit for significant 
scaling behavior in the AF, so that for x«Xj the time-scaling property becomes 
negligible at these time scales [18]. AF assumes values near unity for Poisson processes 
[19]. Therefore, if a=0 the point process is Poissonian, which means that the series is 
memoryless and constituted by independent events; while if a>0 the process is 
characterized by time-scaling behaviour, which means that the series is time-correlated. 


4 Results 

Figure 2 shows the relation AF(x)~x in log-log scales for the analyzed ligthning 
sequences. Eq. 3 has been calculated for timescales x ranging between 10 s and T/10, 
where T is the total observation period. The first striking feature is that the lightning 
activity is not globally Poissonian, since the AF curves are not flat for all the timescales x, 
except for the lower timescales, where the behaviour can be considered Poisson-like. In 
particular, two distinct scaling regions are visible in all the AF curves, limited by two 
crossover timescales, xi«400-500 s and x 2 «4-6 hours. In the first region, ranging between 
Xi and x 2 , the AFs scale with x with scaling exponent a«1.7. The second scaling region is 
characterized by the scaling exponent a»0.2-0.3. The crossover timescale x 2 «4-6 hours 
can be linked with the mean duration of a thunderstorm; therefore, the first scaling region 
describes the time-clustering properties of the lightning activity inside a thunderstorm 
(intra-cluster correlations), while the second scaling region describes those among 
different thunderstorms (inter-cluster correlations). From the numerical value of a we 
deduce that the time-clustering of lightning inside a thunderstorm is much stronger than 
that evaluated for lightning charged to the ground during different storms. 

5 Conclusions 

This study shows that lightning activity is characterized by time-clustering behaviour. 
Two years of lightning data recorded in two areas of Italy have been anlyzed. The AF 
methodology has disclosed the presence of two different time-scaling regimes, connected 
with the time-clustering behavior of lightning inside individual thunderstorms (intra¬ 
cluster) and that among successive thunderstorms (inter-cluster); the crossover timescale 
between the two scaling regions could be connected with the average duration of a 
thunderstorm. This study proposes a new approach in investigating the time dynamics of 
lightning sequence. 
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A CORNUCOPIA OF CONNECTIONS: FINDING FOUR FAMILIAR 
FRACTALS IN THE TOWER OF HANOI 


DANER. CAMP 

New Trier High School, 385 Winnetka Avenue 
Winnetka, Illinois 60093 USA 


This exposition draws a connection between the Tower of Hanoi puzzle and four well-known 
fractals. These connections are illustrated by examining a graph theoretical picture of the solution 
to the puzzle and identifying patterns within the structure of the graph. The numbering scheme 
introduced by Ian Stewart, in an article he wrote for Scientific American, connects a graphical 
representation of the solution to the Tower of Hanoi to the structure of Sierpinski’s Gasket. Further 
investigation of the solution by the author shows how connections can also be discovered between 
the Tower of Hanoi and three other fractals: the Dragon Curve, Cantor Dust, and the Von Koch 
Curve. 


1 The Towers of Hanoi 

In a land far away in a long distant time 
the priests in a temple played a game quite sublime. 

With 100 disks that were set upon 
3 stout upright pegs they played dusk until dawn. 

For the priests of Hanoi knew when the game was done 
the whole world would end and so would their fun. 

The rules were quite simple for there were but two, 
and if you listen closely, I’ll share them with you. 

The disks could be moved to pegs one at a time, 
to put larger on smaller was considered a crime. 

There were 100 priests, who all played this game 
they each had one disk and took turns by name. 

The 100th priest would utter a curse, 
for he could not move, till the others moved first. 

So the job was now left to priest 99, 
who also cursed softly, and took place in line. 

And so they all lined up cursing and recursing, 
waiting their turn, and mentally rehearsing. 
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their one special move their own sacred place 
in the cosmic scheme and the human race. 

So let us attempt to act out this drama 
for 4 little disks to lessen the trauma. 

And when we are through with this smaller version, 
you will then understand, what we call recursion. 

The Tower of Hanoi is the stuff of legend. My students giggle when we start out our 
lesson on recursion with this poem and then act out the procedure using volunteers from 
the class. After the exercise, I always admit to them that the Tower of Hanoi puzzle is 
really not ancient; it was first marketed by French mathematician Edouard Lucas in 1883. 
However, I add that nesting puzzles of this type have a long and rich history, transcending 
cultural boundaries for they seem to have a deep broad based appeal to the human psyche. 
It is because of this almost mystical universality, triggered by my exposure to Ian 
Stewart’s description of a graph theoretical approach to a solution to the Tower of Hanoi, 
and coupled with my intense passion for fractal geometry, that I decided to search for 
other familiar fractal forms within the puzzle’s solution. 

The puzzle typically consists of n disks that are stacked in descending order of size 
on a peg as shown below in Figure 1 for n = 4. The object is to move all of the disks from 
the present peg to one of the other empty pegs, using the additional peg as needed, while 
obeying the following rules: 

1. Disks must only be moved one at a time from one peg to another. 

2. A larger disk cannot be placed upon a smaller disk. 



quarter, nickel, penny and dime.) 

2 The Tower of Hanoi and Sierpinski’s Gasket 

In an article about Sierpinski’s Gasket, Ian Stewart describes a method for illustrating 
the solution to the Tower of Hanoi using graph theory. For one disk, assign the numbers 
1, 2, and 3 to the states corresponding to which peg the disk is resting upon. Draw a 
graph representing the three states and connect those that are adjacent, meaning you can 
get from one to the other in one move, as in Figure 2. 
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Figure 2. The Tower of Hanoi with one disk and its corresponding graph. 


For two disks, do the same thing. In this case, the first [leftmost] digit represents the 
peg upon which the smallest disk rests. The second digit represents the location of the 
larger disk. Figure 3 shows that the graph contains all solutions to the puzzle for two 
disks, namely moving from one vertex to another along the side of the triangle. As a 
matter of fact, any path on the graph corresponds to a series of moves in the puzzle—even 
those that are not solutions. 
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Figure 5. The graph corresponding to the solutions of the Tower of Hanoi for four disks. Again, the 
leftmost digit represents the peg upon which the smallest disk rests and the rightmost digit represents the 
peg upon which the largest disk rests. Notice all of the interesting numerical patterns! 

3 The Dragon Curve 

Not only do we have to wonder, in both senses of the word, about the appearance of 
Sierpinski’s gasket in the solution to the Tower of Hanoi, but we should be curious as to 
whether other familiar fractals might also be connected to the Tower of Hanoi. Consider 
the stages of the Sierpinski Gasket solution to the Tower of Hanoi. Imagine that each disk 
in the original Tower has a head and a tail, like a coin. Each time you move a disk, you 
flip it over. Let L represent a fLip and R represent a flip back, Right side up, from tail to 
head. Now label the edges of the gasket in the following way: 

1. Pick a starting vertex, for example the top. 

2. Pick the target vertex, for example the bottom right. 

3. As you progress from the initial vertex to the terminal vertex, label the edge with an 
L each time you would flip and an R each time you would put the disk right side up 
as illustrated along one side of the triangle in Figure 6. 
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Figure 6. Coin flipping scheme for a solution to the Tower of Hanoi with three disks. Note that the coins, 
which are “tail up”, are underlined. 


Now, take the sequence of L’s and R’s that result from this procedure. Imagine that 
you are a turtle and the sequence represents directions for moving. Now draw the 
sequence by moving one unit then turning 90° Left or Right, then moving one unit turning 
again until the sequence is finished. You have just traced Figure 7, the third stage of a 
Dragon Curve. 



Figure 7. Converting the L’s and R’s to left and right turns yields the third iteration of the Dragon Curve. 
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4 Cantor Dust and the Dragon Curve 

This time let’s start with a fractal—Cantor Dust. The first stage of Cantor Dust is a 
line segment; let’s label it L. Underneath the first stage, put the second stage. This is 
found by duplicating the stage above and removing the middle third. Call the left hand 
segment L and the right hand segment R. Continue constructing the Dust by duplicating 
the previous stage and removing the middle third of each segment labeling the segments 
with an L or an R depending upon whether they are to the left or right of the segment that 
you removed. Completing four stages will yield figure 8. Essentially, you now have a tree 
structure made up of L’s and R’s. 

_L_ 

L R 

L R L R 

_L_ _R_ _L_ _R_ _L _R _L _R 

Figure 8. Stages of Cantor Dust organized in a tree fashion labeled as Left and Right branches. 


Now perform an inorder traversal of the tree. Upon completing stage 4 you would 
have LLRLLRRLLLRRLRR, representing a 4 th stage Dragon Curve corresponding to the 
edge of a 4 th stage Sierpinski Gasket derived from the solution to the Tower of Hanoi with 
4 disks! This is demonstrated in figure 9. 



Figure 9. The fourth iteration of the Dragon Curve found by inorder traversal of the tree of L’s and R’s 
which was derived from generating Cantor Dust. 
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5 The Von Koch Curve 

Finally, let us resort to an alternate coding scheme for the solution to the Tower of 
Hanoi. Let L represent a move to the left one unit and R represent a move to the right one 
unit, where moves “wrap around,” (i.e. a move from 1 to 3 is L and a move from 3 to 1 is 
R) and the size of the letter corresponding to the size of the disk. Figure 10 reveals the 
letter sequence using this scheme for the Tower of Hanoi for 4 disks. 



So the solution for four disks could be represented as the sequence shown below in 
Figure 11: 


rLrRrLrLrLrRrLr 


Figure 11. Right and left 


i solution to the Tower of Hanoi for 4 disks. 
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As you can see, this is a different sequence than the one that yielded the Dragon 
Curve. However, a fractal still lurks inside if we are willing to be creative. Again, pretend 
that you are a turtle, but this time allow R to represent a 60 degree turn clockwise and L to 
represent a 120 degree turn counterclockwise. Does the resulting figure 12 look familiar? 
Yes, it resembles the Von Koch Curve. It should be noted, however, that this connection 
requires that there is an even number of disks in the original tower. 


R R R R r r 



L 


Figure 12. Translating the moves from Figure 10 into the second iteration of the Von Koch Curve. 


6 Conclusion 

As we have seen, the Tower of Hanoi is a rich source of patterns in general and 
fractals in particular. One can’t help but wonder why such a wealth of connections 
naturally unfold from such a simple game. The occurrence of so many fractal structures 
within the solution of a puzzle that involves iteration should not be surprising, however, 
discovering them is still fascinating. These explorations clearly illustrate one of the 
apparently contradictory characteristics of fractal geometry that seems to be so 
pervasive—the feeling that once a fractal structure is identified within the context of a 
problem or a natural phenomenon, it is often both unexpected and obvious at the same 
time. As I searched for fractals within the solution to the Tower of Hanoi, I knew I would 
find them. I am also certain that there are even more. 

Throughout this investigation I was reminded that mathematics is the language of 
patterns. It reinforced my conviction that it is important for me, as a high school teacher, 
to find ways to share the love of patterns with my students and also to instill in them a 
passion for identifying and discovering these patterns themselves. I also can’t help but 
notice that whenever I am looking for patterns, I constantly find myself tripping over 
fractals. I hope that I never cease to experience genuine surprise and wonder when this 
happens. 
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MONITORING THE DEPTH OF ANAESTHESIA 
USING FRACTAL COMPLEXITY METHOD * 
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We propose a simple and effective method of characterizing complexity of EEG-signals for monitoring 
the depth of anaesthesia using Higuchi’s fractal dimension method. We demonstrate that the proposed 
method may compete with the widely used BIS monitoring method. 

Key-Words: - Complexity, Fractal Dimension, EEG, Anaesthesia. 


1. Material and methods 

We proposed a new method for monitoring the depth of anaesthesia by assessing 
fractal complexity of EEG-signal (cf. [1]). There exist several methods of measuring 
fractal dimension of EEG time series ([2],[3]) and there is an extensive literature on 
applying fractal measures from nonlinear dynamics to physiological signals ([4]-[6]). 
When using linear methods, like Fourier spectra or wavelet analysis, one forgets that these 
methods work properly only for stationary signals while biosignals are very non-stationary; 
similarly, when using time-delay method (cf. [7]) for embedding physiological time series 
in a multidimensional phase space and then calculating nonlinear characteristics such as 
e.g. correlation dimension, one forgets that ’embedology' works properly only for signals 
generated by point sources, while biosignals like EEG have complex spatio-temporal 
source structure [8]. To model EEG changes observed during general anesthesia that 
result from spatially-dispersed changes in electrocortical activity, one needs parallelized 
simulations of nonlinear partial differential equations on a grid representing an entire 
human cortex; it requires selection of plausible parameter sets from dozens of thousands 
possible sets and still there are dozens of such plausible sets [9], The method proposed by 
Higuchi [10] yields the fractal dimension directly in time domain without necessity of 
embedding the data in a phase space; the algorithm (cf. Appendix 1) is very simple and so 
it may be applied in real time. It works even with relatively short epochs, also for 
nonstationary signals; it is also highly noise-resistant [11]. 


* This work was partially supported by IBBE PAS St/24/05 and by EC FP6 
Integrated Project SENSATION under grant IST-507231. 
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Following approval from the local Ethics Committee 58 patients during general 
anaesthesia were studied. Patients with known neurological disorders, as well as those 
who were receiving neuropsychiatric medication, were excluded from the study. 
Anaesthesia was induced with fentanyl, midazolam and propofol. 

Brain electrical activity in all patients was measured continuously with an A-2000 BIS 
Monitor (software version: XP, Aspect Medical Systems, Newton, MA, USA) and 
bispectral index (BIS) was recorded every 10 seconds. The bispectral index is commonly 
accepted as a measure of hypnosis during anaesthesia [12], but the algorithms the BIS 
Monitor uses are not in public domain. 

In order to calculate fractal dimension the unprocessed EEG signal was obtained using 
two different data acquisition systems. 

In the first group (30 patients) - the raw, unprocessed EEG signal (±50 pV) was 
recorded from BIS Monitor onto PC with sampling rate 128 Hz using BSA program for 
BIS (version 3.22B2 for A-2000, programmed by S. Hagihira [13]). 

In the second group (28 patients), EEG signal was registered by DigiTrack data 
acquisition system (ELMIKO, Warsaw, Poland), sampled with 250 Hz and filtered with a 
bandpass filter 3.5-50 Hz. 

The recorded copy of the EEG was reviewed and proceed postoperatively to calculate 
Higuchi‘s fractal dimension. The results were averaged every 10 s for epochs 30 s long. 
Since \<D/<2 the fractal dimension value has been presented as it’s derivative: (Df - 
1)*100 to adjust the scale for better comparison with BIS. 

In addition, depth of anaesthesia was continuously tested and classified by a 
specialist-anaesthesiologist to six OAA/S (Observer’s Assessment of Alertness and 
Sedation) levels [14] (cf. Appendix 2); patients were judged to be conscious if the OAA/S 
score was between 3 - 5 and unconscious if the OAA/S score was less then 3. Pearson or 
Spearman correlation coefficient (r) were used to compare Dy-with BIS Index. 


2. Results 

We analyzed EEG-signals post-operatively and demonstrated that the fractal dimension 
corresponds to the depth of anaesthesia. Below we demonstrate four interesting cases. In 
each case we show three variables - OAA/S, BIS, and fractal dimension (£>/-l)*100 
during the whole procedure. In addition exact dosage and timing of drugs administration 
is illustrated. 
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Case nr 1 



Case 1. A 40-year-old female, weighting 67 kg was anaesthetised for elective 
colonoscopy. Anaesthesia was induced with fentanyl (0,1 mg), midazolam (2 mg) and 
propofol (titrated to keep OAA/S bellow 2) up to a total dose of 60 mg in this case. The 
fractal dimension and the BIS present basically similar behaviour during induction, 
maintenance and termination of anaesthesia. But the (Z)/-l)*100 started to decrease 25 
seconds before the alteration of BIS value after the initial dose of propofol. Essential 
changes in the (Z>^-1)*100 occurred 5 to 25 seconds earlier then BIS changes during the 
whole procedure. 


Case nr 2 



Case 2. A 62-year-old female, weighting 68 kg, anaesthetized for elective colonoscopy 
in the similar way as in case nr 1. Anaesthesia was lightened twice during the procedure 
(OAA/S score greater than 0). At the moments of return of eye-lid reflex (Z) / -l)*100 
rose rapidly to rich higher level then before sedation. Those increases in (£y-l)*100 
were more significant and occurred earlier then rises of BIS. This finding could have 
predictable value to avoid unnecessary awakenings during anaesthesia. 
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Case nr 3 



Case 3. A 31-year-old male, weighting 76 kg, was anaesthetized for colonoscopy as 
described above. In spite of administrating much higher doses of propofol, moments of 
lightening of anaesthesia were observed at 12 th and 18 th minutes of the study. Increasing 
OAA/S score evoked almost parallel changes in values of BIS and of (Z)y-l)*100. Once 
again changes of (£yi)*100 occurred earlier and more rapidly than increasing of BIS 
value. 


Case nr 4 



Case 4. In this case sedation (instead of anaesthesia) has been employed to secure 
adequate comfort for 65-year-old male patient during long, unpleasant procedure 
(colonoscopy with polypectomy). Sedation has been controlled according to the BIS 
(target BIS value between 60 and 80) with intermittent boluses of propofol. At 16 th and 
27 th minutes of the study sedation was lightened to level 3 in OAA/S score. Record 
showed that at those moments (Dyl)*100 rose rapidly to rich the highest value. BIS 
increased only once (at 27 th minute) while at 16 th minute remained unchanged. 
Awakening during and in the end of sedation can be predicted by rise of the (Z>yl)*100 
towards its highest value. 
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Tables 1 and 2 show percentage of: almost perfect (1), very high (2), high (3), and 
average (4) positive correlation between D f and BIS during anaesthesia (induction and 
awaking from anaesthesia). 

On the results of the first group of 30 patients the Pearson parametric test of 
correlation between fractal dimension and BIS was performed. Fractal dimension values 
were averaged in 30-second window every 10 second to compare both measures correctly. 
Fractal dimension changes correlate well with BIS behaviour during anaesthetic induction 
(mean Pearson correlation coefficient r=0.81±0.2; p=0.02) and during awakening from 
anaesthesia (r= 0.76±0.2; p=0.016) (Table 1). 

Parameters distributions in the second group of patients in most cases were not normal 
(Shapiro-Wilk test was performed to prove it). So, nonparametric Spearman test was 
performed in this case (Table 2). 


Table 1. Percentage of positive correlation between Df and BIS 
during anaesthetic induction and during awakening from anaesthesia (1 st group). 



r 

induction - n (%) 

awakening - n (%) 

1 

0.9 <r< 1 

13 (43.3%) 

9 (30%) 

2 

0.7 < r< 0.9 

12 (40%) 

12 (40%) 

3 

0.5 < r< 0.7 

2 (6.7%) 

5 (16.7%) 

4 

0.3 < r< 0.5 

3 (10%) 

4(13.3%) 


Table 2. Percentage of positive correlation between Df and BIS 
calculated for the whole procedure under anaesthesia (2 nd group). 



r 

n (%) 

1 

0.9 < r < 1 

5 (17.86%) 

2 

0.7 < r< 0.9 

18 (64.29%) 

3 

0.5 <r<0.7 

3 (10.71%) 

4 

0.3 < r<0.5 

2(7.14%) 


Our result demonstrate that correlation between Df and BIS in both groups of patients are 
very high (r > 0.7) in over 70% of cases. 
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3. Conclusions 

There is a still growing need for relatively simple methods for computer-assisted non- 
invasive monitoring of patient in OR’s and ICU’s. Fractal methods of biosignal analysis 
can be very useful for these purposes. Application of methods borrowed from Nonlinear 
Dynamics and Symbolic Dynamics seems to be very promising - the methods are efficient 
and user-friendly. 

Medicine may benefit from methods of time series analysis developed in Nonlinear 
Dynamics and Deterministic Chaos Theory, in particular from fractal and symbolic 
methods of analysis in time domain. As yet there is no consensus on the appropriate 
mathematical analysis of EEG-signals. Each method has its inherent advantages and 
disadvantages. Since a clinician must remain a necessary ‘component’ of diagnostic 
procedure he/she must understand the strength and the limitations of the computer-assisted 
assessment procedure. That is why, despite inherent nonlinearity and nonstationarity of 
EEG, applied methods must be sufficiently simple to be understandable for clinicians. It 
seems that our fractal method may fulfil these demands of relative simplicity. 

The method we propose may find several applications. It may be used for analysis of 
other biosignals, like EOG, ECG, etc. Because it is simple and sufficiently quick to be 
applied in a real time it may be used with new nano-sensors. In general, application in 
biosignal analysis of the methods borrowed from Nonlinear Dynamics seems to be very 
promising - the methods are efficient for computer-assisted medical assessment. We have 
previously successfully applied Higuchi's method to different biosignals analysis, like 
automatic sleep staging based on analysis of sleep-EEG ([14], [15]). Here we have shown 
that Higuchi's fractal dimension method may be successfully applied to analysis of EEG- 
signal for monitoring of the depth of anaesthesia. The algorithm is easy and fast with 
respect to other methods and gives compression of information - on one-page it is possible 
to have information about EEG signal few hundred minutes long. The algorithm is also 
very quick and may be implemented in real time even on a PC. The patent for monitoring 
the depth of anaesthesia using fractal complexity method is pending [17]. 
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Appendix 1 

Higuchi’s Fractal Dimension Method 

Higuchi’s algorithm measures fractal dimension of a time series directly in the time 
domain. It is based on a measure of length, L(k), of the curve that represents the 
considered time series while using a segment of k samples as a unit. If L{k) scales like 

L(k)~k° f 

the curve is said to show fractal dimension Df. Because a simple curve has dimension 
equal 1 and a plane has dimension equal 2 value of Df is always between 1 (for a 
simple curve) and 2 (for a curve which nearly fills out the whole plane). Df measures 
complexity of the curve and so of the time series this curve represents on a graph. 

From a given time series: A"(l), X(2), ... , X(N) the algorithm constructs k new 
time series, X k m : 

X{m\ X(m + k), X(m + 2k),..., X(m + int ((N-m)/k)xk) 

for m=\,2,...,k where m - initial time, k - time interval, int(r) - integer part of a 
real numbers. 

For example, for A=4 and 7V=1000 the algorithm produces 4 time series: 

Xf = X(l), *(5),*(9),..., *(997) 

X* = *(2), *(6),*(10). X (998) 

X 4 = X (3), X(J), X (11). X (999) 

X 4 = X(4), A(8),Z(12),..., *(1000) 

The ‘length’ L m (k) of each curve X k m is then calculated as: 

“Pr) 

\X(m+ixk)~X(m+(i -1)x£)| 


where N- the total number of samples. 

Lm(k) is not the ‘length’ in Euclidean sense, it represents the normalized sum of 
absolute values of differences in ordinates of pair of points distant k (with initial point 
m). The length of curve for the time interval k, L(k) , is calculated as the mean of the k 
values Lm(k) for m=1,2,...,k \ 
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IM*) 

L(k) = ^ - (A.l) 

The value of fractal dimension Df is calculated by a least-squares linear best-fitting 
procedure as the angular coefficient of the linear regression of the log-log graph of (A.l): 

y = ax+b (A.2) 

namely 

according to the following formulae: 

D GM)-£*.!>■ 

where: y k = ln(£), x k = ln(J/Q, k = k,, ..... k max and n denotes the number of k 
values for which the linear regression is calculated (2 < n < k max ).-, c is a scaling factor - 
Higuchi’s fractal dimension shows a scaling feature - multiplication of all amplitudes 
by a constant factor, c, does not change D f . The standard deviation of D f is calculated 
as: 

“"il 

where (cf. eq. (A.2)): 


S s = 



vith standard deviation 
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Appendix 2 

Observer's Assessment of Alertness and Sedation Scale (OAA/S) 


Responsiveness 

Speech 

Facial 

Expression 

Eyes 

Composite 

Score 

Responds readily 
to name spoken in 
normal tone 

Normal 

Normal 

Clear, no 
ptosis 

5 (alert) 

Lethargic 
response to name 
spoken in normal 
tone 

Mild slowing or 
thickening 

Mild relaxation 

Glazed or 
mild ptosis 
(less than 
half the 
eye) 

4 

Responds only 
after name is 
called loudly or 
repeatedly 

Slurring or 
prominent 
slowing 

Marked 
relaxation 
(slack jaw) 

Glazed and 
marked 
ptosis (half 
the eye or 
more) 

3 

Responds only 
after mild 
prodding or 
shaking 

Few 

recognizable 

words 



2 

Does not respond 
to mild prodding 
or shaking 




1 

Does not respond 
to noxious stimuli. 
No eyelid reflex 




0 
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THE COMPLEX COUPLINGS AND GOMPERTZIAN DYNAMICS 
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The universal dynamics of growth and self-organization of cellular dynamic systems is 
described by the Gompertz function, 1 Eq. (1): 

m = e°^ ( 1 ) 

in which f(t) stands for example for a number of cells, volume, or their weight after time 
t, a and b are experimental coefficients determining slope of the curve. Since 
Gompertzian dynamics is so universal in nature, a question arises how this dynamics 
emerges? 

For the purpose of this study, space is defined by a system of the geometrical co¬ 
ordinates. Those co-ordinates build up a volume, in which the nonlinear process with 
Gompertzian dynamics occurs. Time is a scalar with the same features as in any other 
dynamic equation. Owing to the relationship with the system of co-ordinates, time is a 
parameter and takes the sense of the evolutional co-ordinate. 

First, we demonstrate that time and space are coupled to each other through non¬ 
linear Gompertzian dynamics. This coupling determines the existence of fractal time- 
space in which growth occurs. The appropriate equation possesses the following 
algebraic form, Eq. (2): 


In 


A 0 a | P 


( 2 ) 


in which x is a scalar, geometrical variable, which locates an effect in space, t stands for 
scalar time, V 0 and V denote the volumes of the growing cellular system after time t 0 and 
f, respectively. A, A 0 stand for the scaling coefficients, a and b are experimental 
coefficients determining slope of the Gompertz curve, [d is the temporal fractal 
dimension, cris the spatial fractal dimension 1 . 

Second, we find that Gompertzian dynamics emerges at the macroscopic level as a 
result of coupling of stochastic phenomena at the microscopic level. Indeed, analysis of 
the linear differential equation of the first order, which generates the Gompertz function 
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as a solution, reveals the existence of a complex coupling of probabilities. If the 
normalized Gompertz functionf/t) is given by Eq. (3): 

f N (t) = e~ e ~ bt (3) 

and b=r, fp(0 = Pit), then 0 < p(t) < 1 for any t, and e~ bt = -\np(t), the 
normalized derivative gets a form given by Eq. (4): 

p'(t) = rp(t)(-in p(t)) (4) 

The Eq. (4) can be transfonned to the iterated form given by Eq. (5): 

Pn+l = r P n (-^P n ) + Pn ( 5 ) 

The iterated equation with the above-defined coupling of probabilities generates 
Feigenbaum-like diagram. That latter diagram indicates that the Gompertz function 
describes an equilibrium between regular processes, that is, processes with dynamics 
that are predictable for any time-point, (e.g., sinusoidal glycolytic oscillations) and 
chaotic processes, that is, processes with dynamics that are unpredictable in time, but 
are characterized by certain regularities, (e.g., the existence of strange attractor for any 
biochemical reaction)'. 

It is worth to notice that Gompertzian dynamics also defines the function of the 
Shannon entropy S: 

In (0 = Pit) = J P' (t)dt = -r j pit) In pm = rS (6) 

0 0 

This suggests the existence of a relationship between both fractal dimensions, 
Gompertzian dynamics and Kolmogorov-Sinai entropy (see Eq. 2). 

Finally, we find that Gompertzian dynamics appears in the models with the 
simpliest couplings, such as the Langevin equation with the stationary differential 
Markov chain. Indeed, the conditional probability density P(v, t) can be expressed in the 
form of the following equation with the Gompertz function f(t) in its structure, Eq. (7): 

M(t) 

oo i—ik | e _/l ( f_T W(r)) 

p (vJ)= \^(e 0 )f(t)\k\“ (7) 

Fractal Gompertzian dynamics is generated owing to both the complex coupling of 
probabilities of stochastic processes at the microscopic scale and the existence of fractal 
structure of time and space; the essence.of life. The existence of fractal structure of time- 
space for non-linear phenomena with Gompertzian dynamics implies application of 
fractional differential equations in the mathematical models of growth. 


Reference 


1. P. Waliszewski and J. Konarski, Biosystems. 80 , 91 (2005). 



Index 

Al-Ghoul M., 225 
AlaburdaM., 277 
Allegrini P., 43 
Ayad G., 287 

Barbi F., 43 
Bari A., 287 
Berbardi M., 313 
Brown A. H. D„ 287 
Budde C. E„ 237 

Camp D. R., 323 
CapousekR., 217 

FujiharaA., 147 

Galenko P.K., 199 
Goles E., 297 
Gontis V., 277 

Gonzalez-Andujar J. L., 287 
Gorenflo R., 33 
Grazzini J„ 247 
Grigolini R, 43 

Haase M., 181 
Haderka J„ 305 
HakenH., 155 
Herlach D. M., 199 
Hodgkin T., 287 

Jalowiecki P., 333 
Jerabkova P., 305 
Jirsa V. K„ 1 

Kaulakys B., 277 
Klonowski W., 333 
Konarski J., 343 
Korotkikh G., 63 
Korotkikh V., 63 

Liebovitcb L. S., 1 
Lv T.-Y., 257 

Mainardi F., 33 


MainzerK., 113 
Markus M., 297 
Martin A., 287 
MartynT., 103 
Meskauskas T., 277 
MiraCh., 83 
Miyazima S., 147 
Mora A., 181 
Msharrafieh M., 225 

Ohtsuki T., 147 
Olejarczyk E., 333 

Padulosi S., 287 
Pallikari F„ 53 
Papasimakis N„ 53 
Paradisi P., 43 
ParischH., 181 
Pearson M., 135 
Perez-Vicente C., 73 
Plath P.-J., 181 

RabbowT., 181 
Revelli J. A., 237 
Rosen B.-G., 191 
Rovelli C., 313 
Rudner R„ 333 

Sakaguchi H., 209 
SalaN., 171 
Schmick M„ 297 
Shehadeh L. A., 1 
Sing B,, 267 
StefkovaP., 217 
Stepien R., 333 
Sultan R., 225 

Telesca L., 313 
Thomas T. R., 191 
Tokunaga S., 209 
Turiel A., 73, 247 

Waliszewski P., 343 
Wang Z.-X., 257 


345 



346 


West B. J„ 9 
Wio H. S„ 237 

YahiaH., 247 
Yamamoto H., 147 
Yamamoto K., 147 

Zhang X.Z., 257 
ZmeskalO., 217, 305 



Complexus Mundi 

Emergent Patterns in Nature 

The dynamics of complex systems can clarify the creation 
of structures in Nature. This creation is driven by the 
collective interaction of constitutive elements of the 
system. Such interactions are frequently nonlinear and 
are directly responsible for the lack of prediction in the 
evolution process. The self-organization accompanying 
these processes occurs all around us and is constantly 
being rediscovered, under the guise of a new jargon, in 
apparently unrelated disciplines. 

This volume offers unique perspectives on aspects of 
fractals and complexity and, through the examination of 
complementary techniques, provides a unifying thread in 
this multidisciplinary endeavour. Do nonlinear interactions 
play a role in the complexity management of socio-econo- 
political systems? Is it possible to extract the global 
properties of genetic regulatory networks without knowing 
the details of individual genes? What can one learn by 
transplanting the self-organization effects known in laser 
processes to the study of emotions? What can the change in 
the level of complexity tell us about the physiological state 
of the organism?The reader will enjoy finding the answers 
to these questions and many more in this book. 
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